├── LICENSE ├── MANIFEST.in ├── README.md ├── assets ├── Yoshua_Bengio.jpg ├── controlnet_result.jpg ├── fight.jpg ├── ghibli_diffusion.jpg ├── hidiffusion_logo.jpg ├── hidiffusion_logo.png ├── image_gallery.jpg ├── inpainting_result.jpg ├── lara.jpeg ├── lara_result.jpg ├── lich_king.jpeg ├── mask_image.png ├── playground_result.jpg ├── quality_efficiency.jpg ├── sd15.jpg ├── sd21.jpg ├── sdxl.jpg ├── sdxl_turbo.jpg └── various_task.jpg ├── example.ipynb ├── hidiffusion ├── __init__.py ├── hidiffusion.py ├── sd_module_key │ ├── sd15_module_key.txt │ └── sdxl_module_key.txt └── utils.py ├── requirements.txt └── setup.py /LICENSE: -------------------------------------------------------------------------------- 1 | Apache License 2 | Version 2.0, January 2004 3 | http://www.apache.org/licenses/ 4 | 5 | TERMS AND CONDITIONS FOR USE, REPRODUCTION, AND DISTRIBUTION 6 | 7 | 1. Definitions. 8 | 9 | "License" shall mean the terms and conditions for use, reproduction, 10 | and distribution as defined by Sections 1 through 9 of this document. 11 | 12 | "Licensor" shall mean the copyright owner or entity authorized by 13 | the copyright owner that is granting the License. 14 | 15 | "Legal Entity" shall mean the union of the acting entity and all 16 | other entities that control, are controlled by, or are under common 17 | control with that entity. For the purposes of this definition, 18 | "control" means (i) the power, direct or indirect, to cause the 19 | direction or management of such entity, whether by contract or 20 | otherwise, or (ii) ownership of fifty percent (50%) or more of the 21 | outstanding shares, or (iii) beneficial ownership of such entity. 22 | 23 | "You" (or "Your") shall mean an individual or Legal Entity 24 | exercising permissions granted by this License. 25 | 26 | "Source" form shall mean the preferred form for making modifications, 27 | including but not limited to software source code, documentation 28 | source, and configuration files. 29 | 30 | "Object" form shall mean any form resulting from mechanical 31 | transformation or translation of a Source form, including but 32 | not limited to compiled object code, generated documentation, 33 | and conversions to other media types. 34 | 35 | "Work" shall mean the work of authorship, whether in Source or 36 | Object form, made available under the License, as indicated by a 37 | copyright notice that is included in or attached to the work 38 | (an example is provided in the Appendix below). 39 | 40 | "Derivative Works" shall mean any work, whether in Source or Object 41 | form, that is based on (or derived from) the Work and for which the 42 | editorial revisions, annotations, elaborations, or other modifications 43 | represent, as a whole, an original work of authorship. For the purposes 44 | of this License, Derivative Works shall not include works that remain 45 | separable from, or merely link (or bind by name) to the interfaces of, 46 | the Work and Derivative Works thereof. 47 | 48 | "Contribution" shall mean any work of authorship, including 49 | the original version of the Work and any modifications or additions 50 | to that Work or Derivative Works thereof, that is intentionally 51 | submitted to Licensor for inclusion in the Work by the copyright owner 52 | or by an individual or Legal Entity authorized to submit on behalf of 53 | the copyright owner. For the purposes of this definition, "submitted" 54 | means any form of electronic, verbal, or written communication sent 55 | to the Licensor or its representatives, including but not limited to 56 | communication on electronic mailing lists, source code control systems, 57 | and issue tracking systems that are managed by, or on behalf of, the 58 | Licensor for the purpose of discussing and improving the Work, but 59 | excluding communication that is conspicuously marked or otherwise 60 | designated in writing by the copyright owner as "Not a Contribution." 61 | 62 | "Contributor" shall mean Licensor and any individual or Legal Entity 63 | on behalf of whom a Contribution has been received by Licensor and 64 | subsequently incorporated within the Work. 65 | 66 | 2. Grant of Copyright License. Subject to the terms and conditions of 67 | this License, each Contributor hereby grants to You a perpetual, 68 | worldwide, non-exclusive, no-charge, royalty-free, irrevocable 69 | copyright license to reproduce, prepare Derivative Works of, 70 | publicly display, publicly perform, sublicense, and distribute the 71 | Work and such Derivative Works in Source or Object form. 72 | 73 | 3. Grant of Patent License. Subject to the terms and conditions of 74 | this License, each Contributor hereby grants to You a perpetual, 75 | worldwide, non-exclusive, no-charge, royalty-free, irrevocable 76 | (except as stated in this section) patent license to make, have made, 77 | use, offer to sell, sell, import, and otherwise transfer the Work, 78 | where such license applies only to those patent claims licensable 79 | by such Contributor that are necessarily infringed by their 80 | Contribution(s) alone or by combination of their Contribution(s) 81 | with the Work to which such Contribution(s) was submitted. If You 82 | institute patent litigation against any entity (including a 83 | cross-claim or counterclaim in a lawsuit) alleging that the Work 84 | or a Contribution incorporated within the Work constitutes direct 85 | or contributory patent infringement, then any patent licenses 86 | granted to You under this License for that Work shall terminate 87 | as of the date such litigation is filed. 88 | 89 | 4. Redistribution. You may reproduce and distribute copies of the 90 | Work or Derivative Works thereof in any medium, with or without 91 | modifications, and in Source or Object form, provided that You 92 | meet the following conditions: 93 | 94 | (a) You must give any other recipients of the Work or 95 | Derivative Works a copy of this License; and 96 | 97 | (b) You must cause any modified files to carry prominent notices 98 | stating that You changed the files; and 99 | 100 | (c) You must retain, in the Source form of any Derivative Works 101 | that You distribute, all copyright, patent, trademark, and 102 | attribution notices from the Source form of the Work, 103 | excluding those notices that do not pertain to any part of 104 | the Derivative Works; and 105 | 106 | (d) If the Work includes a "NOTICE" text file as part of its 107 | distribution, then any Derivative Works that You distribute must 108 | include a readable copy of the attribution notices contained 109 | within such NOTICE file, excluding those notices that do not 110 | pertain to any part of the Derivative Works, in at least one 111 | of the following places: within a NOTICE text file distributed 112 | as part of the Derivative Works; within the Source form or 113 | documentation, if provided along with the Derivative Works; or, 114 | within a display generated by the Derivative Works, if and 115 | wherever such third-party notices normally appear. The contents 116 | of the NOTICE file are for informational purposes only and 117 | do not modify the License. You may add Your own attribution 118 | notices within Derivative Works that You distribute, alongside 119 | or as an addendum to the NOTICE text from the Work, provided 120 | that such additional attribution notices cannot be construed 121 | as modifying the License. 122 | 123 | You may add Your own copyright statement to Your modifications and 124 | may provide additional or different license terms and conditions 125 | for use, reproduction, or distribution of Your modifications, or 126 | for any such Derivative Works as a whole, provided Your use, 127 | reproduction, and distribution of the Work otherwise complies with 128 | the conditions stated in this License. 129 | 130 | 5. Submission of Contributions. Unless You explicitly state otherwise, 131 | any Contribution intentionally submitted for inclusion in the Work 132 | by You to the Licensor shall be under the terms and conditions of 133 | this License, without any additional terms or conditions. 134 | Notwithstanding the above, nothing herein shall supersede or modify 135 | the terms of any separate license agreement you may have executed 136 | with Licensor regarding such Contributions. 137 | 138 | 6. Trademarks. This License does not grant permission to use the trade 139 | names, trademarks, service marks, or product names of the Licensor, 140 | except as required for reasonable and customary use in describing the 141 | origin of the Work and reproducing the content of the NOTICE file. 142 | 143 | 7. Disclaimer of Warranty. Unless required by applicable law or 144 | agreed to in writing, Licensor provides the Work (and each 145 | Contributor provides its Contributions) on an "AS IS" BASIS, 146 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or 147 | implied, including, without limitation, any warranties or conditions 148 | of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A 149 | PARTICULAR PURPOSE. You are solely responsible for determining the 150 | appropriateness of using or redistributing the Work and assume any 151 | risks associated with Your exercise of permissions under this License. 152 | 153 | 8. Limitation of Liability. In no event and under no legal theory, 154 | whether in tort (including negligence), contract, or otherwise, 155 | unless required by applicable law (such as deliberate and grossly 156 | negligent acts) or agreed to in writing, shall any Contributor be 157 | liable to You for damages, including any direct, indirect, special, 158 | incidental, or consequential damages of any character arising as a 159 | result of this License or out of the use or inability to use the 160 | Work (including but not limited to damages for loss of goodwill, 161 | work stoppage, computer failure or malfunction, or any and all 162 | other commercial damages or losses), even if such Contributor 163 | has been advised of the possibility of such damages. 164 | 165 | 9. Accepting Warranty or Additional Liability. While redistributing 166 | the Work or Derivative Works thereof, You may choose to offer, 167 | and charge a fee for, acceptance of support, warranty, indemnity, 168 | or other liability obligations and/or rights consistent with this 169 | License. However, in accepting such obligations, You may act only 170 | on Your own behalf and on Your sole responsibility, not on behalf 171 | of any other Contributor, and only if You agree to indemnify, 172 | defend, and hold each Contributor harmless for any liability 173 | incurred by, or claims asserted against, such Contributor by reason 174 | of your accepting any such warranty or additional liability. 175 | 176 | END OF TERMS AND CONDITIONS 177 | 178 | APPENDIX: How to apply the Apache License to your work. 179 | 180 | To apply the Apache License to your work, attach the following 181 | boilerplate notice, with the fields enclosed by brackets "[]" 182 | replaced with your own identifying information. (Don't include 183 | the brackets!) The text should be enclosed in the appropriate 184 | comment syntax for the file format. We also recommend that a 185 | file or class name and description of purpose be included on the 186 | same "printed page" as the copyright notice for easier 187 | identification within third-party archives. 188 | 189 | Copyright [yyyy] [name of copyright owner] 190 | 191 | Licensed under the Apache License, Version 2.0 (the "License"); 192 | you may not use this file except in compliance with the License. 193 | You may obtain a copy of the License at 194 | 195 | http://www.apache.org/licenses/LICENSE-2.0 196 | 197 | Unless required by applicable law or agreed to in writing, software 198 | distributed under the License is distributed on an "AS IS" BASIS, 199 | WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. 200 | See the License for the specific language governing permissions and 201 | limitations under the License. 202 | -------------------------------------------------------------------------------- /MANIFEST.in: -------------------------------------------------------------------------------- 1 | recursive-include hidiffusion *.txt -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | 2 | 3 |
4 | 5 |
6 | 7 | ###
💡 HiDiffusion: Unlocking Higher-Resolution Creativity and Efficiency in Pretrained Diffusion Models
8 | 9 |
Shen Zhang, Zhaowei Chen, Zhenyu Zhao, Yuhao Chen, Yao Tang, Jiajun Liang
10 | 11 |
12 | 13 |
14 |   15 |   16 |   17 |   18 |   19 |
20 | 21 |
22 | 23 |
24 | 25 | (Select HiDiffusion samples for various diffusion models, resolutions, and aspect ratios.) 26 | 27 |
28 |
29 | 30 | 31 | ## 👉 Why HiDiffusion 32 | 33 | - A **training-free method that increases the resolution and speed of pretrained diffusion models.** 34 | - Designed as a **plug-and-play implementation**. It can be integrated into diffusion pipelines by **only adding a single line of code**! 35 | - Supports various tasks, including **text-to-image, image-to-image, inpainting**. 36 | 37 |
38 | 39 |
40 | 41 | (Faster, and better image details.) 42 | 43 |
44 |
45 | 46 |
47 | 48 |
49 | 50 | (2K results of ControlNet and inpainting tasks.) 51 | 52 |
53 |
54 | 55 | ## 🔥 Update 56 | - 2024.8.15 - 💥 [Diffusers](https://github.com/huggingface/diffusers) documentation has added HiDiffusion, see [here](https://huggingface.co/docs/diffusers/community_projects). Thank Diffusers team! 57 | 58 | - 2024.7.3 - 💥 Accepted by ECCV 2024! 59 | 60 | - 2024.6.19 - 💥 Integrated into [OpenBayes](https://openbayes.com/), see the [demo](https://openbayes.com/console/public/tutorials/SaPYcYCaWSA). Thank OpenBayes team! 61 | 62 | - 2024.6.16 - 💥 Support PyTorch 2.X. 63 | 64 | - 2024.6.16 - 💥 Fix non-square generation issue. Now HiDiffusion supports more image sizes and aspect ratios. 65 | 66 | - 2024.5.7 - 💥 Support image-to-image task, see [here](#image-to-image-generation). 67 | 68 | - 2024.4.16 - 💥 Release source code. 69 | 70 | 71 | ## 📢 Supported Models 72 | 73 | - ✅ [Stable Diffusion XL](https://huggingface.co/papers/2307.01952) 74 | - ✅ [Stable Diffusion XL Turbo](https://huggingface.co/stabilityai/sdxl-turbo) 75 | - ✅ [Stable Diffusion v2](https://huggingface.co/stabilityai/stable-diffusion-2-1) 76 | - ✅ [Stable Diffusion v1](https://huggingface.co/runwayml/stable-diffusion-v1-5) 77 | 78 | **Note**: HiDiffusion also supports the downstream diffusion models based on these repositories, such as [Ghibli-Diffusion](https://huggingface.co/nitrosocke/Ghibli-Diffusion), [Playground](https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic), etc. 79 | 80 | ## 💣 Supported Tasks 81 | 82 | - ✅ Text-to-image 83 | - ✅ ControlNet, including text-to-image, image-to-image 84 | - ✅ Inpainting 85 | 86 | 87 | ## 🔎 Main Requirements 88 | This repository is tested on 89 | * Python==3.8 90 | * torch>=1.13.1 91 | * diffusers>=0.25.0 92 | * transformers 93 | * accelerate 94 | * xformers 95 | 96 | ## 🔑 Install HiDiffusion 97 | After installing the packages in the [main requirements](#-main-requirements), install HiDiffusion: 98 | ```shell 99 | pip3 install hidiffusion 100 | ``` 101 | ### Installing from source 102 | Alternatively, you can install from github source. Clone the repository and install: 103 | ```bash 104 | git clone https://github.com/megvii-model/HiDiffusion.git 105 | cd HiDiffusion 106 | python3 setup.py install 107 | ``` 108 | 109 | 110 | ## 🚀 Usage 111 | 112 | Generating outputs with HiDiffusion is super easy based on 🤗 [diffusers](https://github.com/huggingface/diffusers/tree/main). **You just need to add a single line of code**. 113 | 114 | ## Text-to-image generation 115 | 116 | ### Stable Diffusion XL 117 | 118 | ```python 119 | from hidiffusion import apply_hidiffusion, remove_hidiffusion 120 | from diffusers import StableDiffusionXLPipeline, DDIMScheduler 121 | import torch 122 | pretrain_model = "stabilityai/stable-diffusion-xl-base-1.0" 123 | scheduler = DDIMScheduler.from_pretrained(pretrain_model, subfolder="scheduler") 124 | pipe = StableDiffusionXLPipeline.from_pretrained(pretrain_model, scheduler = scheduler, torch_dtype=torch.float16, variant="fp16").to("cuda") 125 | 126 | # # Optional. enable_xformers_memory_efficient_attention can save memory usage and increase inference speed. enable_model_cpu_offload and enable_vae_tiling can save memory usage. 127 | # pipe.enable_xformers_memory_efficient_attention() 128 | # pipe.enable_model_cpu_offload() 129 | # pipe.enable_vae_tiling() 130 | 131 | # Apply hidiffusion with a single line of code. 132 | apply_hidiffusion(pipe) 133 | 134 | prompt = "Standing tall amidst the ruins, a stone golem awakens, vines and flowers sprouting from the crevices in its body." 135 | negative_prompt = "blurry, ugly, duplicate, poorly drawn face, deformed, mosaic, artifacts, bad limbs" 136 | image = pipe(prompt, guidance_scale=7.5, height=2048, width=2048, eta=1.0, negative_prompt=negative_prompt).images[0] 137 | image.save(f"golem.jpg") 138 | ``` 139 | 140 |
141 | Output: 142 |
143 | 144 |
145 |
146 | 147 | Set height = 4096, width = 4096, and you can get output with 4096x4096 resolution. 148 | 149 | ### Stable Diffusion XL Turbo 150 | 151 | ```python 152 | from hidiffusion import apply_hidiffusion, remove_hidiffusion 153 | from diffusers import AutoPipelineForText2Image 154 | import torch 155 | pretrain_model = "stabilityai/sdxl-turbo" 156 | pipe = AutoPipelineForText2Image.from_pretrained(pretrain_model, torch_dtype=torch.float16, variant="fp16").to('cuda') 157 | 158 | # # Optional. enable_xformers_memory_efficient_attention can save memory usage and increase inference speed. enable_model_cpu_offload and enable_vae_tiling can save memory usage. 159 | # pipe.enable_xformers_memory_efficient_attention() 160 | # pipe.enable_model_cpu_offload() 161 | # pipe.enable_vae_tiling() 162 | 163 | # Apply hidiffusion with a single line of code. 164 | apply_hidiffusion(pipe) 165 | 166 | prompt = "In the depths of a mystical forest, a robotic owl with night vision lenses for eyes watches over the nocturnal creatures." 167 | image = pipe(prompt, num_inference_steps=4, height=1024, width=1024, guidance_scale=0.0).images[0] 168 | image.save(f"./owl.jpg") 169 | ``` 170 | 171 |
172 | Output: 173 |
174 | 175 |
176 |
177 | 178 | ### Stable Diffusion v2-1 179 | 180 | ```python 181 | from hidiffusion import apply_hidiffusion, remove_hidiffusion 182 | from diffusers import DiffusionPipeline, DDIMScheduler 183 | import torch 184 | pretrain_model = "stabilityai/stable-diffusion-2-1-base" 185 | scheduler = DDIMScheduler.from_pretrained(pretrain_model, subfolder="scheduler") 186 | pipe = DiffusionPipeline.from_pretrained(pretrain_model, scheduler = scheduler, torch_dtype=torch.float16).to("cuda") 187 | 188 | # # Optional. enable_xformers_memory_efficient_attention can save memory usage and increase inference speed. enable_model_cpu_offload and enable_vae_tiling can save memory usage. 189 | # pipe.enable_xformers_memory_efficient_attention() 190 | # pipe.enable_model_cpu_offload() 191 | # pipe.enable_vae_tiling() 192 | 193 | # Apply hidiffusion with a single line of code. 194 | apply_hidiffusion(pipe) 195 | 196 | prompt = "An adorable happy brown border collie sitting on a bed, high detail." 197 | negative_prompt = "ugly, tiling, out of frame, poorly drawn face, extra limbs, disfigured, deformed, body out of frame, blurry, bad anatomy, blurred, artifacts, bad proportions." 198 | image = pipe(prompt, guidance_scale=7.5, height=1024, width=1024, eta=1.0, negative_prompt=negative_prompt).images[0] 199 | image.save(f"collie.jpg") 200 | ``` 201 | 202 |
203 | Output: 204 |
205 | 206 |
207 |
208 | 209 | Set height = 2048, width = 2048, and you can get output with 2048x2048 resolution. 210 | 211 | 212 | 213 | ### Stable Diffusion v1-5 214 | 215 | ```python 216 | from hidiffusion import apply_hidiffusion, remove_hidiffusion 217 | from diffusers import DiffusionPipeline, DDIMScheduler 218 | import torch 219 | pretrain_model = "runwayml/stable-diffusion-v1-5" 220 | scheduler = DDIMScheduler.from_pretrained(pretrain_model, subfolder="scheduler") 221 | pipe = DiffusionPipeline.from_pretrained(pretrain_model, scheduler = scheduler, torch_dtype=torch.float16).to("cuda") 222 | 223 | # # Optional. enable_xformers_memory_efficient_attention can save memory usage and increase inference speed. enable_model_cpu_offload and enable_vae_tiling can save memory usage. 224 | # pipe.enable_xformers_memory_efficient_attention() 225 | # pipe.enable_model_cpu_offload() 226 | # pipe.enable_vae_tiling() 227 | 228 | # Apply hidiffusion with a single line of code. 229 | apply_hidiffusion(pipe) 230 | 231 | prompt = "thick strokes, bright colors, an exotic fox, cute, chibi kawaii. detailed fur, hyperdetailed , big reflective eyes, fairytale, artstation,centered composition, perfect composition, centered, vibrant colors, muted colors, high detailed, 8k." 232 | negative_prompt = "ugly, tiling, poorly drawn face, out of frame, disfigured, deformed, blurry, bad anatomy, blurred." 233 | image = pipe(prompt, guidance_scale=7.5, height=1024, width=1024, eta=1.0, negative_prompt=negative_prompt).images[0] 234 | image.save(f"fox.jpg") 235 | ``` 236 | 237 |
238 | Output: 239 |
240 | 241 |
242 |
243 | 244 | Set height = 2048, width = 2048, and you can get output with 2048x2048 resolution. 245 | 246 | ### Remove HiDiffusion 247 | 248 | If you want to remove HiDiiffusion, simply use `remove_hidiffusion(pipe)`. 249 | 250 | ## ControlNet 251 | 252 | ### Text-to-image generation 253 | ```python 254 | from diffusers import StableDiffusionXLControlNetPipeline, ControlNetModel, DDIMScheduler 255 | import numpy as np 256 | import torch 257 | import cv2 258 | from PIL import Image 259 | from hidiffusion import apply_hidiffusion, remove_hidiffusion 260 | 261 | # load Yoshua_Bengio.jpg in the assets file. 262 | path = './assets/Yoshua_Bengio.jpg' 263 | image = Image.open(path) 264 | # get canny image 265 | image = np.array(image) 266 | image = cv2.Canny(image, 100, 200) 267 | image = image[:, :, None] 268 | image = np.concatenate([image, image, image], axis=2) 269 | canny_image = Image.fromarray(image) 270 | 271 | # initialize the models and pipeline 272 | controlnet_conditioning_scale = 0.5 # recommended for good generalization 273 | controlnet = ControlNetModel.from_pretrained( 274 | "diffusers/controlnet-canny-sdxl-1.0", torch_dtype=torch.float16, variant="fp16" 275 | ) 276 | scheduler = DDIMScheduler.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", subfolder="scheduler") 277 | pipe = StableDiffusionXLControlNetPipeline.from_pretrained( 278 | "stabilityai/stable-diffusion-xl-base-1.0", controlnet=controlnet, torch_dtype=torch.float16, 279 | scheduler = scheduler 280 | ) 281 | 282 | # Apply hidiffusion with a single line of code. 283 | apply_hidiffusion(pipe) 284 | 285 | pipe.enable_model_cpu_offload() 286 | pipe.enable_xformers_memory_efficient_attention() 287 | 288 | prompt = "The Joker, high face detail, high detail, muted color, 8k" 289 | negative_prompt = "blurry, ugly, duplicate, poorly drawn, deformed, mosaic." 290 | 291 | image = pipe( 292 | prompt, controlnet_conditioning_scale=controlnet_conditioning_scale, image=canny_image, 293 | height=2048, width=2048, guidance_scale=7.5, negative_prompt = negative_prompt, eta=1.0 294 | ).images[0] 295 | 296 | image.save('joker.jpg') 297 | ``` 298 | 299 |
300 | Output: 301 |
302 | 303 |
304 |
305 | 306 | 307 | ### Image-to-image generation 308 | ```python 309 | import torch 310 | import numpy as np 311 | from PIL import Image 312 | from diffusers import ControlNetModel, StableDiffusionXLControlNetImg2ImgPipeline, DDIMScheduler 313 | from hidiffusion import apply_hidiffusion, remove_hidiffusion 314 | import cv2 315 | 316 | controlnet = ControlNetModel.from_pretrained( 317 | "diffusers/controlnet-canny-sdxl-1.0", torch_dtype=torch.float16, variant="fp16" 318 | ).to("cuda") 319 | scheduler = DDIMScheduler.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", subfolder="scheduler") 320 | 321 | pipe = StableDiffusionXLControlNetImg2ImgPipeline.from_pretrained( 322 | "stabilityai/stable-diffusion-xl-base-1.0", 323 | controlnet=controlnet, 324 | scheduler = scheduler, 325 | torch_dtype=torch.float16, 326 | ).to("cuda") 327 | 328 | # Apply hidiffusion with a single line of code. 329 | apply_hidiffusion(pipe) 330 | 331 | pipe.enable_model_cpu_offload() 332 | pipe.enable_xformers_memory_efficient_attention() 333 | 334 | path = './assets/lara.jpeg' 335 | ori_image = Image.open(path) 336 | # get canny image 337 | image = np.array(ori_image) 338 | image = cv2.Canny(image, 50, 120) 339 | image = image[:, :, None] 340 | image = np.concatenate([image, image, image], axis=2) 341 | canny_image = Image.fromarray(image) 342 | 343 | controlnet_conditioning_scale = 0.5 # recommended for good generalization 344 | prompt = "Lara Croft with brown hair, and is wearing a tank top, a brown backpack. The room is dark and has an old-fashioned decor with a patterned floor and a wall featuring a design with arches and a dark area on the right side, muted color, high detail, 8k high definition award winning" 345 | negative_prompt = "underexposed, poorly drawn hands, duplicate hands, overexposed, bad art, beginner, amateur, abstract, disfigured, deformed, close up, weird colors, watermark" 346 | 347 | image = pipe(prompt, 348 | image=ori_image, 349 | control_image=canny_image, 350 | height=1536, 351 | width=2048, 352 | strength=0.99, 353 | num_inference_steps=50, 354 | controlnet_conditioning_scale=controlnet_conditioning_scale, 355 | guidance_scale=12.5, 356 | negative_prompt = negative_prompt, 357 | eta=1.0 358 | ).images[0] 359 | 360 | image.save("lara.jpg") 361 | ``` 362 | 363 |
364 | Output: 365 |
366 | 367 |
368 |
369 | 370 | ## Inpainting 371 | 372 | ```python 373 | import torch 374 | from diffusers import AutoPipelineForInpainting, DDIMScheduler 375 | from diffusers.utils import load_image 376 | from hidiffusion import apply_hidiffusion, remove_hidiffusion 377 | from PIL import Image 378 | 379 | scheduler = DDIMScheduler.from_pretrained("stabilityai/stable-diffusion-xl-base-1.0", subfolder="scheduler") 380 | pipeline = AutoPipelineForInpainting.from_pretrained( 381 | "diffusers/stable-diffusion-xl-1.0-inpainting-0.1", torch_dtype=torch.float16, variant="fp16", 382 | scheduler=scheduler 383 | ) 384 | 385 | # Apply hidiffusion with a single line of code. 386 | apply_hidiffusion(pipeline) 387 | 388 | pipeline.enable_model_cpu_offload() 389 | # remove following line if xFormers is not installed 390 | pipeline.enable_xformers_memory_efficient_attention() 391 | 392 | # load base and mask image 393 | img_url = "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/sdxl-text2img.png" 394 | init_image = load_image(img_url) 395 | # load mask_image.jpg in the assets file. 396 | mask_image = Image.open("./assets/mask_image.png") 397 | 398 | prompt = "A steampunk explorer in a leather aviator cap and goggles, with a brass telescope in hand, stands amidst towering ancient trees, their roots entwined with intricate gears and pipes." 399 | 400 | negative_prompt = "blurry, ugly, duplicate, poorly drawn, deformed, mosaic" 401 | image = pipeline(prompt=prompt, image=init_image, mask_image=mask_image, height=2048, width=2048, strength=0.85, guidance_scale=12.5, negative_prompt = negative_prompt, eta=1.0).images[0] 402 | image.save('steampunk_explorer.jpg') 403 | ``` 404 | 405 |
406 | Output: 407 |
408 | 409 |
410 |
411 | 412 | 413 | ## Integration into downstream models 414 | HiDiffusion supports models based on [supported models](#-supported-models), such as [Ghibli-Diffusion](https://huggingface.co/nitrosocke/Ghibli-Diffusion), [Playground](https://huggingface.co/playgroundai/playground-v2-1024px-aesthetic), etc. 415 | 416 | ### Ghibli-Diffusion 417 | ```python 418 | from diffusers import StableDiffusionPipeline 419 | import torch 420 | from hidiffusion import apply_hidiffusion, remove_hidiffusion 421 | 422 | model_id = "nitrosocke/Ghibli-Diffusion" 423 | pipe = StableDiffusionPipeline.from_pretrained(model_id, torch_dtype=torch.float16) 424 | pipe = pipe.to("cuda") 425 | 426 | # Apply hidiffusion with a single line of code. 427 | apply_hidiffusion(pipe) 428 | 429 | prompt = "ghibli style magical princess with golden hair" 430 | negative_prompt="blurry, ugly, duplicate, poorly drawn face, deformed, mosaic, artifacts, bad limbs" 431 | image = pipe(prompt, height=1024, width=1024, eta=1.0, negative_prompt=negative_prompt).images[0] 432 | 433 | image.save("./magical_princess.jpg") 434 | ``` 435 |
436 | Output: 437 |
438 | 439 |
440 |
441 | 442 | ### Playground 443 | 444 | ```python 445 | from diffusers import DiffusionPipeline 446 | import torch 447 | from hidiffusion import apply_hidiffusion, remove_hidiffusion 448 | 449 | pipe = DiffusionPipeline.from_pretrained( 450 | "playgroundai/playground-v2-1024px-aesthetic", 451 | torch_dtype=torch.float16, 452 | use_safetensors=True, 453 | add_watermarker=False, 454 | variant="fp16" 455 | ) 456 | pipe.to("cuda") 457 | pipe.enable_xformers_memory_efficient_attention() 458 | 459 | # Apply hidiffusion with a single line of code. 460 | apply_hidiffusion(pipe) 461 | 462 | prompt = "The little girl riding a bike, in a beautiful anime scene by Hayao Miyazaki: a snowy Tokyo city with massive Miyazaki clouds floating in the blue sky, enchanting snowscapes of the city with bright sunlight, Miyazaki's landscape imagery, Japanese art" 463 | negative_prompt="blurry, ugly, duplicate, poorly drawn, deformed, mosaic" 464 | image = pipe(prompt=prompt, guidance_scale=3.0, height=2048, width=2048, negative_prompt=negative_prompt).images[0] 465 | image.save('girl.jpg') 466 | ``` 467 | 468 | Note: You may change guidance scale from 3.0 to 5.0 and design appropriate negative prompt to generate satisfactory results. 469 | 470 |
471 | Output: 472 |
473 | 474 |
475 |
476 | 477 | ## 🙏 Acknowledgements 478 | 479 | This codebase is based on [tomesd](https://github.com/dbolya/tomesd) and [diffusers](https://github.com/huggingface/diffusers/tree/main). Thanks! 480 | 481 | 482 | 483 | ## 🎓 Citation 484 | 485 | ``` 486 | @inproceedings{zhang2025hidiffusion, 487 | title={HiDiffusion: Unlocking Higher-Resolution Creativity and Efficiency in Pretrained Diffusion Models}, 488 | author={Zhang, Shen and Chen, Zhaowei and Zhao, Zhenyu and Chen, Yuhao and Tang, Yao and Liang, Jiajun}, 489 | booktitle={European Conference on Computer Vision}, 490 | pages={145--161}, 491 | year={2025}, 492 | organization={Springer} 493 | } 494 | ``` 495 | -------------------------------------------------------------------------------- /assets/Yoshua_Bengio.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/Yoshua_Bengio.jpg -------------------------------------------------------------------------------- /assets/controlnet_result.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/controlnet_result.jpg -------------------------------------------------------------------------------- /assets/fight.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/fight.jpg -------------------------------------------------------------------------------- /assets/ghibli_diffusion.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/ghibli_diffusion.jpg -------------------------------------------------------------------------------- /assets/hidiffusion_logo.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/hidiffusion_logo.jpg -------------------------------------------------------------------------------- /assets/hidiffusion_logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/hidiffusion_logo.png -------------------------------------------------------------------------------- /assets/image_gallery.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/image_gallery.jpg -------------------------------------------------------------------------------- /assets/inpainting_result.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/inpainting_result.jpg -------------------------------------------------------------------------------- /assets/lara.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/lara.jpeg -------------------------------------------------------------------------------- /assets/lara_result.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/lara_result.jpg -------------------------------------------------------------------------------- /assets/lich_king.jpeg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/lich_king.jpeg -------------------------------------------------------------------------------- /assets/mask_image.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/mask_image.png -------------------------------------------------------------------------------- /assets/playground_result.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/playground_result.jpg -------------------------------------------------------------------------------- /assets/quality_efficiency.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/quality_efficiency.jpg -------------------------------------------------------------------------------- /assets/sd15.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/sd15.jpg -------------------------------------------------------------------------------- /assets/sd21.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/sd21.jpg -------------------------------------------------------------------------------- /assets/sdxl.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/sdxl.jpg -------------------------------------------------------------------------------- /assets/sdxl_turbo.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/sdxl_turbo.jpg -------------------------------------------------------------------------------- /assets/various_task.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/megvii-research/HiDiffusion/580c838d8d7ac1f742137127fe0c493792df6543/assets/various_task.jpg -------------------------------------------------------------------------------- /hidiffusion/__init__.py: -------------------------------------------------------------------------------- 1 | from .hidiffusion import apply_hidiffusion, remove_hidiffusion 2 | 3 | __all__ = ["apply_hidiffusion", "remove_hidiffusion"] 4 | -------------------------------------------------------------------------------- /hidiffusion/sd_module_key/sd15_module_key.txt: -------------------------------------------------------------------------------- 1 | conv_in 2 | time_proj 3 | time_embedding 4 | time_embedding.linear_1 5 | time_embedding.act 6 | time_embedding.linear_2 7 | down_blocks 8 | down_blocks.0 9 | down_blocks.0.attentions 10 | down_blocks.0.attentions.0 11 | down_blocks.0.attentions.0.norm 12 | down_blocks.0.attentions.0.proj_in 13 | down_blocks.0.attentions.0.transformer_blocks 14 | down_blocks.0.attentions.0.transformer_blocks.0 15 | down_blocks.0.attentions.0.transformer_blocks.0.norm1 16 | down_blocks.0.attentions.0.transformer_blocks.0.attn1 17 | down_blocks.0.attentions.0.transformer_blocks.0.attn1.to_q 18 | down_blocks.0.attentions.0.transformer_blocks.0.attn1.to_k 19 | down_blocks.0.attentions.0.transformer_blocks.0.attn1.to_v 20 | down_blocks.0.attentions.0.transformer_blocks.0.attn1.to_out 21 | down_blocks.0.attentions.0.transformer_blocks.0.attn1.to_out.0 22 | down_blocks.0.attentions.0.transformer_blocks.0.attn1.to_out.1 23 | down_blocks.0.attentions.0.transformer_blocks.0.norm2 24 | down_blocks.0.attentions.0.transformer_blocks.0.attn2 25 | down_blocks.0.attentions.0.transformer_blocks.0.attn2.to_q 26 | down_blocks.0.attentions.0.transformer_blocks.0.attn2.to_k 27 | down_blocks.0.attentions.0.transformer_blocks.0.attn2.to_v 28 | down_blocks.0.attentions.0.transformer_blocks.0.attn2.to_out 29 | down_blocks.0.attentions.0.transformer_blocks.0.attn2.to_out.0 30 | down_blocks.0.attentions.0.transformer_blocks.0.attn2.to_out.1 31 | down_blocks.0.attentions.0.transformer_blocks.0.norm3 32 | down_blocks.0.attentions.0.transformer_blocks.0.ff 33 | down_blocks.0.attentions.0.transformer_blocks.0.ff.net 34 | down_blocks.0.attentions.0.transformer_blocks.0.ff.net.0 35 | down_blocks.0.attentions.0.transformer_blocks.0.ff.net.0.proj 36 | down_blocks.0.attentions.0.transformer_blocks.0.ff.net.1 37 | down_blocks.0.attentions.0.transformer_blocks.0.ff.net.2 38 | down_blocks.0.attentions.0.proj_out 39 | down_blocks.0.attentions.1 40 | down_blocks.0.attentions.1.norm 41 | down_blocks.0.attentions.1.proj_in 42 | down_blocks.0.attentions.1.transformer_blocks 43 | down_blocks.0.attentions.1.transformer_blocks.0 44 | down_blocks.0.attentions.1.transformer_blocks.0.norm1 45 | down_blocks.0.attentions.1.transformer_blocks.0.attn1 46 | down_blocks.0.attentions.1.transformer_blocks.0.attn1.to_q 47 | down_blocks.0.attentions.1.transformer_blocks.0.attn1.to_k 48 | down_blocks.0.attentions.1.transformer_blocks.0.attn1.to_v 49 | down_blocks.0.attentions.1.transformer_blocks.0.attn1.to_out 50 | down_blocks.0.attentions.1.transformer_blocks.0.attn1.to_out.0 51 | down_blocks.0.attentions.1.transformer_blocks.0.attn1.to_out.1 52 | down_blocks.0.attentions.1.transformer_blocks.0.norm2 53 | down_blocks.0.attentions.1.transformer_blocks.0.attn2 54 | down_blocks.0.attentions.1.transformer_blocks.0.attn2.to_q 55 | down_blocks.0.attentions.1.transformer_blocks.0.attn2.to_k 56 | down_blocks.0.attentions.1.transformer_blocks.0.attn2.to_v 57 | down_blocks.0.attentions.1.transformer_blocks.0.attn2.to_out 58 | down_blocks.0.attentions.1.transformer_blocks.0.attn2.to_out.0 59 | down_blocks.0.attentions.1.transformer_blocks.0.attn2.to_out.1 60 | down_blocks.0.attentions.1.transformer_blocks.0.norm3 61 | down_blocks.0.attentions.1.transformer_blocks.0.ff 62 | down_blocks.0.attentions.1.transformer_blocks.0.ff.net 63 | down_blocks.0.attentions.1.transformer_blocks.0.ff.net.0 64 | down_blocks.0.attentions.1.transformer_blocks.0.ff.net.0.proj 65 | down_blocks.0.attentions.1.transformer_blocks.0.ff.net.1 66 | down_blocks.0.attentions.1.transformer_blocks.0.ff.net.2 67 | down_blocks.0.attentions.1.proj_out 68 | down_blocks.0.resnets 69 | down_blocks.0.resnets.0 70 | down_blocks.0.resnets.0.norm1 71 | down_blocks.0.resnets.0.conv1 72 | down_blocks.0.resnets.0.time_emb_proj 73 | down_blocks.0.resnets.0.norm2 74 | down_blocks.0.resnets.0.dropout 75 | down_blocks.0.resnets.0.conv2 76 | down_blocks.0.resnets.1 77 | down_blocks.0.resnets.1.norm1 78 | down_blocks.0.resnets.1.conv1 79 | down_blocks.0.resnets.1.time_emb_proj 80 | down_blocks.0.resnets.1.norm2 81 | down_blocks.0.resnets.1.dropout 82 | down_blocks.0.resnets.1.conv2 83 | down_blocks.0.downsamplers 84 | down_blocks.0.downsamplers.0 85 | down_blocks.0.downsamplers.0.conv 86 | down_blocks.1 87 | down_blocks.1.attentions 88 | down_blocks.1.attentions.0 89 | down_blocks.1.attentions.0.norm 90 | down_blocks.1.attentions.0.proj_in 91 | down_blocks.1.attentions.0.transformer_blocks 92 | down_blocks.1.attentions.0.transformer_blocks.0 93 | down_blocks.1.attentions.0.transformer_blocks.0.norm1 94 | down_blocks.1.attentions.0.transformer_blocks.0.attn1 95 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_q 96 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_k 97 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_v 98 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out 99 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.0 100 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.1 101 | down_blocks.1.attentions.0.transformer_blocks.0.norm2 102 | down_blocks.1.attentions.0.transformer_blocks.0.attn2 103 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_q 104 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_k 105 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_v 106 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out 107 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out.0 108 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out.1 109 | down_blocks.1.attentions.0.transformer_blocks.0.norm3 110 | down_blocks.1.attentions.0.transformer_blocks.0.ff 111 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net 112 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net.0 113 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net.0.proj 114 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net.1 115 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net.2 116 | down_blocks.1.attentions.0.proj_out 117 | down_blocks.1.attentions.1 118 | down_blocks.1.attentions.1.norm 119 | down_blocks.1.attentions.1.proj_in 120 | down_blocks.1.attentions.1.transformer_blocks 121 | down_blocks.1.attentions.1.transformer_blocks.0 122 | down_blocks.1.attentions.1.transformer_blocks.0.norm1 123 | down_blocks.1.attentions.1.transformer_blocks.0.attn1 124 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_q 125 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_k 126 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_v 127 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out 128 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out.0 129 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out.1 130 | down_blocks.1.attentions.1.transformer_blocks.0.norm2 131 | down_blocks.1.attentions.1.transformer_blocks.0.attn2 132 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_q 133 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_k 134 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_v 135 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out 136 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out.0 137 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out.1 138 | down_blocks.1.attentions.1.transformer_blocks.0.norm3 139 | down_blocks.1.attentions.1.transformer_blocks.0.ff 140 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net 141 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net.0 142 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net.0.proj 143 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net.1 144 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net.2 145 | down_blocks.1.attentions.1.proj_out 146 | down_blocks.1.resnets 147 | down_blocks.1.resnets.0 148 | down_blocks.1.resnets.0.norm1 149 | down_blocks.1.resnets.0.conv1 150 | down_blocks.1.resnets.0.time_emb_proj 151 | down_blocks.1.resnets.0.norm2 152 | down_blocks.1.resnets.0.dropout 153 | down_blocks.1.resnets.0.conv2 154 | down_blocks.1.resnets.0.conv_shortcut 155 | down_blocks.1.resnets.1 156 | down_blocks.1.resnets.1.norm1 157 | down_blocks.1.resnets.1.conv1 158 | down_blocks.1.resnets.1.time_emb_proj 159 | down_blocks.1.resnets.1.norm2 160 | down_blocks.1.resnets.1.dropout 161 | down_blocks.1.resnets.1.conv2 162 | down_blocks.1.downsamplers 163 | down_blocks.1.downsamplers.0 164 | down_blocks.1.downsamplers.0.conv 165 | down_blocks.2 166 | down_blocks.2.attentions 167 | down_blocks.2.attentions.0 168 | down_blocks.2.attentions.0.norm 169 | down_blocks.2.attentions.0.proj_in 170 | down_blocks.2.attentions.0.transformer_blocks 171 | down_blocks.2.attentions.0.transformer_blocks.0 172 | down_blocks.2.attentions.0.transformer_blocks.0.norm1 173 | down_blocks.2.attentions.0.transformer_blocks.0.attn1 174 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_q 175 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_k 176 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_v 177 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out 178 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out.0 179 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out.1 180 | down_blocks.2.attentions.0.transformer_blocks.0.norm2 181 | down_blocks.2.attentions.0.transformer_blocks.0.attn2 182 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_q 183 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_k 184 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_v 185 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out 186 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out.0 187 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out.1 188 | down_blocks.2.attentions.0.transformer_blocks.0.norm3 189 | down_blocks.2.attentions.0.transformer_blocks.0.ff 190 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net 191 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net.0 192 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net.0.proj 193 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net.1 194 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net.2 195 | down_blocks.2.attentions.0.proj_out 196 | down_blocks.2.attentions.1 197 | down_blocks.2.attentions.1.norm 198 | down_blocks.2.attentions.1.proj_in 199 | down_blocks.2.attentions.1.transformer_blocks 200 | down_blocks.2.attentions.1.transformer_blocks.0 201 | down_blocks.2.attentions.1.transformer_blocks.0.norm1 202 | down_blocks.2.attentions.1.transformer_blocks.0.attn1 203 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_q 204 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_k 205 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_v 206 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out 207 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out.0 208 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out.1 209 | down_blocks.2.attentions.1.transformer_blocks.0.norm2 210 | down_blocks.2.attentions.1.transformer_blocks.0.attn2 211 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_q 212 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_k 213 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_v 214 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out 215 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out.0 216 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out.1 217 | down_blocks.2.attentions.1.transformer_blocks.0.norm3 218 | down_blocks.2.attentions.1.transformer_blocks.0.ff 219 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net 220 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net.0 221 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net.0.proj 222 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net.1 223 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net.2 224 | down_blocks.2.attentions.1.proj_out 225 | down_blocks.2.resnets 226 | down_blocks.2.resnets.0 227 | down_blocks.2.resnets.0.norm1 228 | down_blocks.2.resnets.0.conv1 229 | down_blocks.2.resnets.0.time_emb_proj 230 | down_blocks.2.resnets.0.norm2 231 | down_blocks.2.resnets.0.dropout 232 | down_blocks.2.resnets.0.conv2 233 | down_blocks.2.resnets.0.conv_shortcut 234 | down_blocks.2.resnets.1 235 | down_blocks.2.resnets.1.norm1 236 | down_blocks.2.resnets.1.conv1 237 | down_blocks.2.resnets.1.time_emb_proj 238 | down_blocks.2.resnets.1.norm2 239 | down_blocks.2.resnets.1.dropout 240 | down_blocks.2.resnets.1.conv2 241 | down_blocks.2.downsamplers 242 | down_blocks.2.downsamplers.0 243 | down_blocks.2.downsamplers.0.conv 244 | down_blocks.3 245 | down_blocks.3.resnets 246 | down_blocks.3.resnets.0 247 | down_blocks.3.resnets.0.norm1 248 | down_blocks.3.resnets.0.conv1 249 | down_blocks.3.resnets.0.time_emb_proj 250 | down_blocks.3.resnets.0.norm2 251 | down_blocks.3.resnets.0.dropout 252 | down_blocks.3.resnets.0.conv2 253 | down_blocks.3.resnets.1 254 | down_blocks.3.resnets.1.norm1 255 | down_blocks.3.resnets.1.conv1 256 | down_blocks.3.resnets.1.time_emb_proj 257 | down_blocks.3.resnets.1.norm2 258 | down_blocks.3.resnets.1.dropout 259 | down_blocks.3.resnets.1.conv2 260 | up_blocks 261 | up_blocks.0 262 | up_blocks.0.resnets 263 | up_blocks.0.resnets.0 264 | up_blocks.0.resnets.0.norm1 265 | up_blocks.0.resnets.0.conv1 266 | up_blocks.0.resnets.0.time_emb_proj 267 | up_blocks.0.resnets.0.norm2 268 | up_blocks.0.resnets.0.dropout 269 | up_blocks.0.resnets.0.conv2 270 | up_blocks.0.resnets.0.conv_shortcut 271 | up_blocks.0.resnets.1 272 | up_blocks.0.resnets.1.norm1 273 | up_blocks.0.resnets.1.conv1 274 | up_blocks.0.resnets.1.time_emb_proj 275 | up_blocks.0.resnets.1.norm2 276 | up_blocks.0.resnets.1.dropout 277 | up_blocks.0.resnets.1.conv2 278 | up_blocks.0.resnets.1.conv_shortcut 279 | up_blocks.0.resnets.2 280 | up_blocks.0.resnets.2.norm1 281 | up_blocks.0.resnets.2.conv1 282 | up_blocks.0.resnets.2.time_emb_proj 283 | up_blocks.0.resnets.2.norm2 284 | up_blocks.0.resnets.2.dropout 285 | up_blocks.0.resnets.2.conv2 286 | up_blocks.0.resnets.2.conv_shortcut 287 | up_blocks.0.upsamplers 288 | up_blocks.0.upsamplers.0 289 | up_blocks.0.upsamplers.0.conv 290 | up_blocks.1 291 | up_blocks.1.attentions 292 | up_blocks.1.attentions.0 293 | up_blocks.1.attentions.0.norm 294 | up_blocks.1.attentions.0.proj_in 295 | up_blocks.1.attentions.0.transformer_blocks 296 | up_blocks.1.attentions.0.transformer_blocks.0 297 | up_blocks.1.attentions.0.transformer_blocks.0.norm1 298 | up_blocks.1.attentions.0.transformer_blocks.0.attn1 299 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_q 300 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_k 301 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_v 302 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out 303 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.0 304 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.1 305 | up_blocks.1.attentions.0.transformer_blocks.0.norm2 306 | up_blocks.1.attentions.0.transformer_blocks.0.attn2 307 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_q 308 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_k 309 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_v 310 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out 311 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out.0 312 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out.1 313 | up_blocks.1.attentions.0.transformer_blocks.0.norm3 314 | up_blocks.1.attentions.0.transformer_blocks.0.ff 315 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net 316 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net.0 317 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net.0.proj 318 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net.1 319 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net.2 320 | up_blocks.1.attentions.0.proj_out 321 | up_blocks.1.attentions.1 322 | up_blocks.1.attentions.1.norm 323 | up_blocks.1.attentions.1.proj_in 324 | up_blocks.1.attentions.1.transformer_blocks 325 | up_blocks.1.attentions.1.transformer_blocks.0 326 | up_blocks.1.attentions.1.transformer_blocks.0.norm1 327 | up_blocks.1.attentions.1.transformer_blocks.0.attn1 328 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_q 329 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_k 330 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_v 331 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out 332 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out.0 333 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out.1 334 | up_blocks.1.attentions.1.transformer_blocks.0.norm2 335 | up_blocks.1.attentions.1.transformer_blocks.0.attn2 336 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_q 337 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_k 338 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_v 339 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out 340 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out.0 341 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out.1 342 | up_blocks.1.attentions.1.transformer_blocks.0.norm3 343 | up_blocks.1.attentions.1.transformer_blocks.0.ff 344 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net 345 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net.0 346 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net.0.proj 347 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net.1 348 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net.2 349 | up_blocks.1.attentions.1.proj_out 350 | up_blocks.1.attentions.2 351 | up_blocks.1.attentions.2.norm 352 | up_blocks.1.attentions.2.proj_in 353 | up_blocks.1.attentions.2.transformer_blocks 354 | up_blocks.1.attentions.2.transformer_blocks.0 355 | up_blocks.1.attentions.2.transformer_blocks.0.norm1 356 | up_blocks.1.attentions.2.transformer_blocks.0.attn1 357 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_q 358 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_k 359 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_v 360 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_out 361 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_out.0 362 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_out.1 363 | up_blocks.1.attentions.2.transformer_blocks.0.norm2 364 | up_blocks.1.attentions.2.transformer_blocks.0.attn2 365 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_q 366 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_k 367 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_v 368 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_out 369 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_out.0 370 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_out.1 371 | up_blocks.1.attentions.2.transformer_blocks.0.norm3 372 | up_blocks.1.attentions.2.transformer_blocks.0.ff 373 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net 374 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net.0 375 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net.0.proj 376 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net.1 377 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net.2 378 | up_blocks.1.attentions.2.proj_out 379 | up_blocks.1.resnets 380 | up_blocks.1.resnets.0 381 | up_blocks.1.resnets.0.norm1 382 | up_blocks.1.resnets.0.conv1 383 | up_blocks.1.resnets.0.time_emb_proj 384 | up_blocks.1.resnets.0.norm2 385 | up_blocks.1.resnets.0.dropout 386 | up_blocks.1.resnets.0.conv2 387 | up_blocks.1.resnets.0.conv_shortcut 388 | up_blocks.1.resnets.1 389 | up_blocks.1.resnets.1.norm1 390 | up_blocks.1.resnets.1.conv1 391 | up_blocks.1.resnets.1.time_emb_proj 392 | up_blocks.1.resnets.1.norm2 393 | up_blocks.1.resnets.1.dropout 394 | up_blocks.1.resnets.1.conv2 395 | up_blocks.1.resnets.1.conv_shortcut 396 | up_blocks.1.resnets.2 397 | up_blocks.1.resnets.2.norm1 398 | up_blocks.1.resnets.2.conv1 399 | up_blocks.1.resnets.2.time_emb_proj 400 | up_blocks.1.resnets.2.norm2 401 | up_blocks.1.resnets.2.dropout 402 | up_blocks.1.resnets.2.conv2 403 | up_blocks.1.resnets.2.conv_shortcut 404 | up_blocks.1.upsamplers 405 | up_blocks.1.upsamplers.0 406 | up_blocks.1.upsamplers.0.conv 407 | up_blocks.2 408 | up_blocks.2.attentions 409 | up_blocks.2.attentions.0 410 | up_blocks.2.attentions.0.norm 411 | up_blocks.2.attentions.0.proj_in 412 | up_blocks.2.attentions.0.transformer_blocks 413 | up_blocks.2.attentions.0.transformer_blocks.0 414 | up_blocks.2.attentions.0.transformer_blocks.0.norm1 415 | up_blocks.2.attentions.0.transformer_blocks.0.attn1 416 | up_blocks.2.attentions.0.transformer_blocks.0.attn1.to_q 417 | up_blocks.2.attentions.0.transformer_blocks.0.attn1.to_k 418 | up_blocks.2.attentions.0.transformer_blocks.0.attn1.to_v 419 | up_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out 420 | up_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out.0 421 | up_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out.1 422 | up_blocks.2.attentions.0.transformer_blocks.0.norm2 423 | up_blocks.2.attentions.0.transformer_blocks.0.attn2 424 | up_blocks.2.attentions.0.transformer_blocks.0.attn2.to_q 425 | up_blocks.2.attentions.0.transformer_blocks.0.attn2.to_k 426 | up_blocks.2.attentions.0.transformer_blocks.0.attn2.to_v 427 | up_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out 428 | up_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out.0 429 | up_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out.1 430 | up_blocks.2.attentions.0.transformer_blocks.0.norm3 431 | up_blocks.2.attentions.0.transformer_blocks.0.ff 432 | up_blocks.2.attentions.0.transformer_blocks.0.ff.net 433 | up_blocks.2.attentions.0.transformer_blocks.0.ff.net.0 434 | up_blocks.2.attentions.0.transformer_blocks.0.ff.net.0.proj 435 | up_blocks.2.attentions.0.transformer_blocks.0.ff.net.1 436 | up_blocks.2.attentions.0.transformer_blocks.0.ff.net.2 437 | up_blocks.2.attentions.0.proj_out 438 | up_blocks.2.attentions.1 439 | up_blocks.2.attentions.1.norm 440 | up_blocks.2.attentions.1.proj_in 441 | up_blocks.2.attentions.1.transformer_blocks 442 | up_blocks.2.attentions.1.transformer_blocks.0 443 | up_blocks.2.attentions.1.transformer_blocks.0.norm1 444 | up_blocks.2.attentions.1.transformer_blocks.0.attn1 445 | up_blocks.2.attentions.1.transformer_blocks.0.attn1.to_q 446 | up_blocks.2.attentions.1.transformer_blocks.0.attn1.to_k 447 | up_blocks.2.attentions.1.transformer_blocks.0.attn1.to_v 448 | up_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out 449 | up_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out.0 450 | up_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out.1 451 | up_blocks.2.attentions.1.transformer_blocks.0.norm2 452 | up_blocks.2.attentions.1.transformer_blocks.0.attn2 453 | up_blocks.2.attentions.1.transformer_blocks.0.attn2.to_q 454 | up_blocks.2.attentions.1.transformer_blocks.0.attn2.to_k 455 | up_blocks.2.attentions.1.transformer_blocks.0.attn2.to_v 456 | up_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out 457 | up_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out.0 458 | up_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out.1 459 | up_blocks.2.attentions.1.transformer_blocks.0.norm3 460 | up_blocks.2.attentions.1.transformer_blocks.0.ff 461 | up_blocks.2.attentions.1.transformer_blocks.0.ff.net 462 | up_blocks.2.attentions.1.transformer_blocks.0.ff.net.0 463 | up_blocks.2.attentions.1.transformer_blocks.0.ff.net.0.proj 464 | up_blocks.2.attentions.1.transformer_blocks.0.ff.net.1 465 | up_blocks.2.attentions.1.transformer_blocks.0.ff.net.2 466 | up_blocks.2.attentions.1.proj_out 467 | up_blocks.2.attentions.2 468 | up_blocks.2.attentions.2.norm 469 | up_blocks.2.attentions.2.proj_in 470 | up_blocks.2.attentions.2.transformer_blocks 471 | up_blocks.2.attentions.2.transformer_blocks.0 472 | up_blocks.2.attentions.2.transformer_blocks.0.norm1 473 | up_blocks.2.attentions.2.transformer_blocks.0.attn1 474 | up_blocks.2.attentions.2.transformer_blocks.0.attn1.to_q 475 | up_blocks.2.attentions.2.transformer_blocks.0.attn1.to_k 476 | up_blocks.2.attentions.2.transformer_blocks.0.attn1.to_v 477 | up_blocks.2.attentions.2.transformer_blocks.0.attn1.to_out 478 | up_blocks.2.attentions.2.transformer_blocks.0.attn1.to_out.0 479 | up_blocks.2.attentions.2.transformer_blocks.0.attn1.to_out.1 480 | up_blocks.2.attentions.2.transformer_blocks.0.norm2 481 | up_blocks.2.attentions.2.transformer_blocks.0.attn2 482 | up_blocks.2.attentions.2.transformer_blocks.0.attn2.to_q 483 | up_blocks.2.attentions.2.transformer_blocks.0.attn2.to_k 484 | up_blocks.2.attentions.2.transformer_blocks.0.attn2.to_v 485 | up_blocks.2.attentions.2.transformer_blocks.0.attn2.to_out 486 | up_blocks.2.attentions.2.transformer_blocks.0.attn2.to_out.0 487 | up_blocks.2.attentions.2.transformer_blocks.0.attn2.to_out.1 488 | up_blocks.2.attentions.2.transformer_blocks.0.norm3 489 | up_blocks.2.attentions.2.transformer_blocks.0.ff 490 | up_blocks.2.attentions.2.transformer_blocks.0.ff.net 491 | up_blocks.2.attentions.2.transformer_blocks.0.ff.net.0 492 | up_blocks.2.attentions.2.transformer_blocks.0.ff.net.0.proj 493 | up_blocks.2.attentions.2.transformer_blocks.0.ff.net.1 494 | up_blocks.2.attentions.2.transformer_blocks.0.ff.net.2 495 | up_blocks.2.attentions.2.proj_out 496 | up_blocks.2.resnets 497 | up_blocks.2.resnets.0 498 | up_blocks.2.resnets.0.norm1 499 | up_blocks.2.resnets.0.conv1 500 | up_blocks.2.resnets.0.time_emb_proj 501 | up_blocks.2.resnets.0.norm2 502 | up_blocks.2.resnets.0.dropout 503 | up_blocks.2.resnets.0.conv2 504 | up_blocks.2.resnets.0.conv_shortcut 505 | up_blocks.2.resnets.1 506 | up_blocks.2.resnets.1.norm1 507 | up_blocks.2.resnets.1.conv1 508 | up_blocks.2.resnets.1.time_emb_proj 509 | up_blocks.2.resnets.1.norm2 510 | up_blocks.2.resnets.1.dropout 511 | up_blocks.2.resnets.1.conv2 512 | up_blocks.2.resnets.1.conv_shortcut 513 | up_blocks.2.resnets.2 514 | up_blocks.2.resnets.2.norm1 515 | up_blocks.2.resnets.2.conv1 516 | up_blocks.2.resnets.2.time_emb_proj 517 | up_blocks.2.resnets.2.norm2 518 | up_blocks.2.resnets.2.dropout 519 | up_blocks.2.resnets.2.conv2 520 | up_blocks.2.resnets.2.conv_shortcut 521 | up_blocks.2.upsamplers 522 | up_blocks.2.upsamplers.0 523 | up_blocks.2.upsamplers.0.conv 524 | up_blocks.3 525 | up_blocks.3.attentions 526 | up_blocks.3.attentions.0 527 | up_blocks.3.attentions.0.norm 528 | up_blocks.3.attentions.0.proj_in 529 | up_blocks.3.attentions.0.transformer_blocks 530 | up_blocks.3.attentions.0.transformer_blocks.0 531 | up_blocks.3.attentions.0.transformer_blocks.0.norm1 532 | up_blocks.3.attentions.0.transformer_blocks.0.attn1 533 | up_blocks.3.attentions.0.transformer_blocks.0.attn1.to_q 534 | up_blocks.3.attentions.0.transformer_blocks.0.attn1.to_k 535 | up_blocks.3.attentions.0.transformer_blocks.0.attn1.to_v 536 | up_blocks.3.attentions.0.transformer_blocks.0.attn1.to_out 537 | up_blocks.3.attentions.0.transformer_blocks.0.attn1.to_out.0 538 | up_blocks.3.attentions.0.transformer_blocks.0.attn1.to_out.1 539 | up_blocks.3.attentions.0.transformer_blocks.0.norm2 540 | up_blocks.3.attentions.0.transformer_blocks.0.attn2 541 | up_blocks.3.attentions.0.transformer_blocks.0.attn2.to_q 542 | up_blocks.3.attentions.0.transformer_blocks.0.attn2.to_k 543 | up_blocks.3.attentions.0.transformer_blocks.0.attn2.to_v 544 | up_blocks.3.attentions.0.transformer_blocks.0.attn2.to_out 545 | up_blocks.3.attentions.0.transformer_blocks.0.attn2.to_out.0 546 | up_blocks.3.attentions.0.transformer_blocks.0.attn2.to_out.1 547 | up_blocks.3.attentions.0.transformer_blocks.0.norm3 548 | up_blocks.3.attentions.0.transformer_blocks.0.ff 549 | up_blocks.3.attentions.0.transformer_blocks.0.ff.net 550 | up_blocks.3.attentions.0.transformer_blocks.0.ff.net.0 551 | up_blocks.3.attentions.0.transformer_blocks.0.ff.net.0.proj 552 | up_blocks.3.attentions.0.transformer_blocks.0.ff.net.1 553 | up_blocks.3.attentions.0.transformer_blocks.0.ff.net.2 554 | up_blocks.3.attentions.0.proj_out 555 | up_blocks.3.attentions.1 556 | up_blocks.3.attentions.1.norm 557 | up_blocks.3.attentions.1.proj_in 558 | up_blocks.3.attentions.1.transformer_blocks 559 | up_blocks.3.attentions.1.transformer_blocks.0 560 | up_blocks.3.attentions.1.transformer_blocks.0.norm1 561 | up_blocks.3.attentions.1.transformer_blocks.0.attn1 562 | up_blocks.3.attentions.1.transformer_blocks.0.attn1.to_q 563 | up_blocks.3.attentions.1.transformer_blocks.0.attn1.to_k 564 | up_blocks.3.attentions.1.transformer_blocks.0.attn1.to_v 565 | up_blocks.3.attentions.1.transformer_blocks.0.attn1.to_out 566 | up_blocks.3.attentions.1.transformer_blocks.0.attn1.to_out.0 567 | up_blocks.3.attentions.1.transformer_blocks.0.attn1.to_out.1 568 | up_blocks.3.attentions.1.transformer_blocks.0.norm2 569 | up_blocks.3.attentions.1.transformer_blocks.0.attn2 570 | up_blocks.3.attentions.1.transformer_blocks.0.attn2.to_q 571 | up_blocks.3.attentions.1.transformer_blocks.0.attn2.to_k 572 | up_blocks.3.attentions.1.transformer_blocks.0.attn2.to_v 573 | up_blocks.3.attentions.1.transformer_blocks.0.attn2.to_out 574 | up_blocks.3.attentions.1.transformer_blocks.0.attn2.to_out.0 575 | up_blocks.3.attentions.1.transformer_blocks.0.attn2.to_out.1 576 | up_blocks.3.attentions.1.transformer_blocks.0.norm3 577 | up_blocks.3.attentions.1.transformer_blocks.0.ff 578 | up_blocks.3.attentions.1.transformer_blocks.0.ff.net 579 | up_blocks.3.attentions.1.transformer_blocks.0.ff.net.0 580 | up_blocks.3.attentions.1.transformer_blocks.0.ff.net.0.proj 581 | up_blocks.3.attentions.1.transformer_blocks.0.ff.net.1 582 | up_blocks.3.attentions.1.transformer_blocks.0.ff.net.2 583 | up_blocks.3.attentions.1.proj_out 584 | up_blocks.3.attentions.2 585 | up_blocks.3.attentions.2.norm 586 | up_blocks.3.attentions.2.proj_in 587 | up_blocks.3.attentions.2.transformer_blocks 588 | up_blocks.3.attentions.2.transformer_blocks.0 589 | up_blocks.3.attentions.2.transformer_blocks.0.norm1 590 | up_blocks.3.attentions.2.transformer_blocks.0.attn1 591 | up_blocks.3.attentions.2.transformer_blocks.0.attn1.to_q 592 | up_blocks.3.attentions.2.transformer_blocks.0.attn1.to_k 593 | up_blocks.3.attentions.2.transformer_blocks.0.attn1.to_v 594 | up_blocks.3.attentions.2.transformer_blocks.0.attn1.to_out 595 | up_blocks.3.attentions.2.transformer_blocks.0.attn1.to_out.0 596 | up_blocks.3.attentions.2.transformer_blocks.0.attn1.to_out.1 597 | up_blocks.3.attentions.2.transformer_blocks.0.norm2 598 | up_blocks.3.attentions.2.transformer_blocks.0.attn2 599 | up_blocks.3.attentions.2.transformer_blocks.0.attn2.to_q 600 | up_blocks.3.attentions.2.transformer_blocks.0.attn2.to_k 601 | up_blocks.3.attentions.2.transformer_blocks.0.attn2.to_v 602 | up_blocks.3.attentions.2.transformer_blocks.0.attn2.to_out 603 | up_blocks.3.attentions.2.transformer_blocks.0.attn2.to_out.0 604 | up_blocks.3.attentions.2.transformer_blocks.0.attn2.to_out.1 605 | up_blocks.3.attentions.2.transformer_blocks.0.norm3 606 | up_blocks.3.attentions.2.transformer_blocks.0.ff 607 | up_blocks.3.attentions.2.transformer_blocks.0.ff.net 608 | up_blocks.3.attentions.2.transformer_blocks.0.ff.net.0 609 | up_blocks.3.attentions.2.transformer_blocks.0.ff.net.0.proj 610 | up_blocks.3.attentions.2.transformer_blocks.0.ff.net.1 611 | up_blocks.3.attentions.2.transformer_blocks.0.ff.net.2 612 | up_blocks.3.attentions.2.proj_out 613 | up_blocks.3.resnets 614 | up_blocks.3.resnets.0 615 | up_blocks.3.resnets.0.norm1 616 | up_blocks.3.resnets.0.conv1 617 | up_blocks.3.resnets.0.time_emb_proj 618 | up_blocks.3.resnets.0.norm2 619 | up_blocks.3.resnets.0.dropout 620 | up_blocks.3.resnets.0.conv2 621 | up_blocks.3.resnets.0.conv_shortcut 622 | up_blocks.3.resnets.1 623 | up_blocks.3.resnets.1.norm1 624 | up_blocks.3.resnets.1.conv1 625 | up_blocks.3.resnets.1.time_emb_proj 626 | up_blocks.3.resnets.1.norm2 627 | up_blocks.3.resnets.1.dropout 628 | up_blocks.3.resnets.1.conv2 629 | up_blocks.3.resnets.1.conv_shortcut 630 | up_blocks.3.resnets.2 631 | up_blocks.3.resnets.2.norm1 632 | up_blocks.3.resnets.2.conv1 633 | up_blocks.3.resnets.2.time_emb_proj 634 | up_blocks.3.resnets.2.norm2 635 | up_blocks.3.resnets.2.dropout 636 | up_blocks.3.resnets.2.conv2 637 | up_blocks.3.resnets.2.conv_shortcut 638 | mid_block 639 | mid_block.attentions 640 | mid_block.attentions.0 641 | mid_block.attentions.0.norm 642 | mid_block.attentions.0.proj_in 643 | mid_block.attentions.0.transformer_blocks 644 | mid_block.attentions.0.transformer_blocks.0 645 | mid_block.attentions.0.transformer_blocks.0.norm1 646 | mid_block.attentions.0.transformer_blocks.0.attn1 647 | mid_block.attentions.0.transformer_blocks.0.attn1.to_q 648 | mid_block.attentions.0.transformer_blocks.0.attn1.to_k 649 | mid_block.attentions.0.transformer_blocks.0.attn1.to_v 650 | mid_block.attentions.0.transformer_blocks.0.attn1.to_out 651 | mid_block.attentions.0.transformer_blocks.0.attn1.to_out.0 652 | mid_block.attentions.0.transformer_blocks.0.attn1.to_out.1 653 | mid_block.attentions.0.transformer_blocks.0.norm2 654 | mid_block.attentions.0.transformer_blocks.0.attn2 655 | mid_block.attentions.0.transformer_blocks.0.attn2.to_q 656 | mid_block.attentions.0.transformer_blocks.0.attn2.to_k 657 | mid_block.attentions.0.transformer_blocks.0.attn2.to_v 658 | mid_block.attentions.0.transformer_blocks.0.attn2.to_out 659 | mid_block.attentions.0.transformer_blocks.0.attn2.to_out.0 660 | mid_block.attentions.0.transformer_blocks.0.attn2.to_out.1 661 | mid_block.attentions.0.transformer_blocks.0.norm3 662 | mid_block.attentions.0.transformer_blocks.0.ff 663 | mid_block.attentions.0.transformer_blocks.0.ff.net 664 | mid_block.attentions.0.transformer_blocks.0.ff.net.0 665 | mid_block.attentions.0.transformer_blocks.0.ff.net.0.proj 666 | mid_block.attentions.0.transformer_blocks.0.ff.net.1 667 | mid_block.attentions.0.transformer_blocks.0.ff.net.2 668 | mid_block.attentions.0.proj_out 669 | mid_block.resnets 670 | mid_block.resnets.0 671 | mid_block.resnets.0.norm1 672 | mid_block.resnets.0.conv1 673 | mid_block.resnets.0.time_emb_proj 674 | mid_block.resnets.0.norm2 675 | mid_block.resnets.0.dropout 676 | mid_block.resnets.0.conv2 677 | mid_block.resnets.1 678 | mid_block.resnets.1.norm1 679 | mid_block.resnets.1.conv1 680 | mid_block.resnets.1.time_emb_proj 681 | mid_block.resnets.1.norm2 682 | mid_block.resnets.1.dropout 683 | mid_block.resnets.1.conv2 684 | conv_norm_out 685 | conv_out 686 | -------------------------------------------------------------------------------- /hidiffusion/sd_module_key/sdxl_module_key.txt: -------------------------------------------------------------------------------- 1 | conv_in 2 | time_proj 3 | time_embedding 4 | time_embedding.linear_1 5 | time_embedding.act 6 | time_embedding.linear_2 7 | add_time_proj 8 | add_embedding 9 | add_embedding.linear_1 10 | add_embedding.linear_2 11 | down_blocks 12 | down_blocks.0 13 | down_blocks.0.resnets 14 | down_blocks.0.resnets.0 15 | down_blocks.0.resnets.0.norm1 16 | down_blocks.0.resnets.0.conv1 17 | down_blocks.0.resnets.0.time_emb_proj 18 | down_blocks.0.resnets.0.norm2 19 | down_blocks.0.resnets.0.dropout 20 | down_blocks.0.resnets.0.conv2 21 | down_blocks.0.resnets.1 22 | down_blocks.0.resnets.1.norm1 23 | down_blocks.0.resnets.1.conv1 24 | down_blocks.0.resnets.1.time_emb_proj 25 | down_blocks.0.resnets.1.norm2 26 | down_blocks.0.resnets.1.dropout 27 | down_blocks.0.resnets.1.conv2 28 | down_blocks.0.downsamplers 29 | down_blocks.0.downsamplers.0 30 | down_blocks.0.downsamplers.0.conv 31 | down_blocks.1 32 | down_blocks.1.attentions 33 | down_blocks.1.attentions.0 34 | down_blocks.1.attentions.0.norm 35 | down_blocks.1.attentions.0.proj_in 36 | down_blocks.1.attentions.0.transformer_blocks 37 | down_blocks.1.attentions.0.transformer_blocks.0 38 | down_blocks.1.attentions.0.transformer_blocks.0.norm1 39 | down_blocks.1.attentions.0.transformer_blocks.0.attn1 40 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_q 41 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_k 42 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_v 43 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out 44 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.0 45 | down_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.1 46 | down_blocks.1.attentions.0.transformer_blocks.0.norm2 47 | down_blocks.1.attentions.0.transformer_blocks.0.attn2 48 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_q 49 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_k 50 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_v 51 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out 52 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out.0 53 | down_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out.1 54 | down_blocks.1.attentions.0.transformer_blocks.0.norm3 55 | down_blocks.1.attentions.0.transformer_blocks.0.ff 56 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net 57 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net.0 58 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net.0.proj 59 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net.1 60 | down_blocks.1.attentions.0.transformer_blocks.0.ff.net.2 61 | down_blocks.1.attentions.0.transformer_blocks.1 62 | down_blocks.1.attentions.0.transformer_blocks.1.norm1 63 | down_blocks.1.attentions.0.transformer_blocks.1.attn1 64 | down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_q 65 | down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_k 66 | down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_v 67 | down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_out 68 | down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_out.0 69 | down_blocks.1.attentions.0.transformer_blocks.1.attn1.to_out.1 70 | down_blocks.1.attentions.0.transformer_blocks.1.norm2 71 | down_blocks.1.attentions.0.transformer_blocks.1.attn2 72 | down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_q 73 | down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_k 74 | down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_v 75 | down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_out 76 | down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_out.0 77 | down_blocks.1.attentions.0.transformer_blocks.1.attn2.to_out.1 78 | down_blocks.1.attentions.0.transformer_blocks.1.norm3 79 | down_blocks.1.attentions.0.transformer_blocks.1.ff 80 | down_blocks.1.attentions.0.transformer_blocks.1.ff.net 81 | down_blocks.1.attentions.0.transformer_blocks.1.ff.net.0 82 | down_blocks.1.attentions.0.transformer_blocks.1.ff.net.0.proj 83 | down_blocks.1.attentions.0.transformer_blocks.1.ff.net.1 84 | down_blocks.1.attentions.0.transformer_blocks.1.ff.net.2 85 | down_blocks.1.attentions.0.proj_out 86 | down_blocks.1.attentions.1 87 | down_blocks.1.attentions.1.norm 88 | down_blocks.1.attentions.1.proj_in 89 | down_blocks.1.attentions.1.transformer_blocks 90 | down_blocks.1.attentions.1.transformer_blocks.0 91 | down_blocks.1.attentions.1.transformer_blocks.0.norm1 92 | down_blocks.1.attentions.1.transformer_blocks.0.attn1 93 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_q 94 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_k 95 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_v 96 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out 97 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out.0 98 | down_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out.1 99 | down_blocks.1.attentions.1.transformer_blocks.0.norm2 100 | down_blocks.1.attentions.1.transformer_blocks.0.attn2 101 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_q 102 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_k 103 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_v 104 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out 105 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out.0 106 | down_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out.1 107 | down_blocks.1.attentions.1.transformer_blocks.0.norm3 108 | down_blocks.1.attentions.1.transformer_blocks.0.ff 109 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net 110 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net.0 111 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net.0.proj 112 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net.1 113 | down_blocks.1.attentions.1.transformer_blocks.0.ff.net.2 114 | down_blocks.1.attentions.1.transformer_blocks.1 115 | down_blocks.1.attentions.1.transformer_blocks.1.norm1 116 | down_blocks.1.attentions.1.transformer_blocks.1.attn1 117 | down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_q 118 | down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_k 119 | down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_v 120 | down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_out 121 | down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_out.0 122 | down_blocks.1.attentions.1.transformer_blocks.1.attn1.to_out.1 123 | down_blocks.1.attentions.1.transformer_blocks.1.norm2 124 | down_blocks.1.attentions.1.transformer_blocks.1.attn2 125 | down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_q 126 | down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_k 127 | down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_v 128 | down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_out 129 | down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_out.0 130 | down_blocks.1.attentions.1.transformer_blocks.1.attn2.to_out.1 131 | down_blocks.1.attentions.1.transformer_blocks.1.norm3 132 | down_blocks.1.attentions.1.transformer_blocks.1.ff 133 | down_blocks.1.attentions.1.transformer_blocks.1.ff.net 134 | down_blocks.1.attentions.1.transformer_blocks.1.ff.net.0 135 | down_blocks.1.attentions.1.transformer_blocks.1.ff.net.0.proj 136 | down_blocks.1.attentions.1.transformer_blocks.1.ff.net.1 137 | down_blocks.1.attentions.1.transformer_blocks.1.ff.net.2 138 | down_blocks.1.attentions.1.proj_out 139 | down_blocks.1.resnets 140 | down_blocks.1.resnets.0 141 | down_blocks.1.resnets.0.norm1 142 | down_blocks.1.resnets.0.conv1 143 | down_blocks.1.resnets.0.time_emb_proj 144 | down_blocks.1.resnets.0.norm2 145 | down_blocks.1.resnets.0.dropout 146 | down_blocks.1.resnets.0.conv2 147 | down_blocks.1.resnets.0.conv_shortcut 148 | down_blocks.1.resnets.1 149 | down_blocks.1.resnets.1.norm1 150 | down_blocks.1.resnets.1.conv1 151 | down_blocks.1.resnets.1.time_emb_proj 152 | down_blocks.1.resnets.1.norm2 153 | down_blocks.1.resnets.1.dropout 154 | down_blocks.1.resnets.1.conv2 155 | down_blocks.1.downsamplers 156 | down_blocks.1.downsamplers.0 157 | down_blocks.1.downsamplers.0.conv 158 | down_blocks.2 159 | down_blocks.2.attentions 160 | down_blocks.2.attentions.0 161 | down_blocks.2.attentions.0.norm 162 | down_blocks.2.attentions.0.proj_in 163 | down_blocks.2.attentions.0.transformer_blocks 164 | down_blocks.2.attentions.0.transformer_blocks.0 165 | down_blocks.2.attentions.0.transformer_blocks.0.norm1 166 | down_blocks.2.attentions.0.transformer_blocks.0.attn1 167 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_q 168 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_k 169 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_v 170 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out 171 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out.0 172 | down_blocks.2.attentions.0.transformer_blocks.0.attn1.to_out.1 173 | down_blocks.2.attentions.0.transformer_blocks.0.norm2 174 | down_blocks.2.attentions.0.transformer_blocks.0.attn2 175 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_q 176 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_k 177 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_v 178 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out 179 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out.0 180 | down_blocks.2.attentions.0.transformer_blocks.0.attn2.to_out.1 181 | down_blocks.2.attentions.0.transformer_blocks.0.norm3 182 | down_blocks.2.attentions.0.transformer_blocks.0.ff 183 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net 184 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net.0 185 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net.0.proj 186 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net.1 187 | down_blocks.2.attentions.0.transformer_blocks.0.ff.net.2 188 | down_blocks.2.attentions.0.transformer_blocks.1 189 | down_blocks.2.attentions.0.transformer_blocks.1.norm1 190 | down_blocks.2.attentions.0.transformer_blocks.1.attn1 191 | down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_q 192 | down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_k 193 | down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_v 194 | down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_out 195 | down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_out.0 196 | down_blocks.2.attentions.0.transformer_blocks.1.attn1.to_out.1 197 | down_blocks.2.attentions.0.transformer_blocks.1.norm2 198 | down_blocks.2.attentions.0.transformer_blocks.1.attn2 199 | down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_q 200 | down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_k 201 | down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_v 202 | down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_out 203 | down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_out.0 204 | down_blocks.2.attentions.0.transformer_blocks.1.attn2.to_out.1 205 | down_blocks.2.attentions.0.transformer_blocks.1.norm3 206 | down_blocks.2.attentions.0.transformer_blocks.1.ff 207 | down_blocks.2.attentions.0.transformer_blocks.1.ff.net 208 | down_blocks.2.attentions.0.transformer_blocks.1.ff.net.0 209 | down_blocks.2.attentions.0.transformer_blocks.1.ff.net.0.proj 210 | down_blocks.2.attentions.0.transformer_blocks.1.ff.net.1 211 | down_blocks.2.attentions.0.transformer_blocks.1.ff.net.2 212 | down_blocks.2.attentions.0.transformer_blocks.2 213 | down_blocks.2.attentions.0.transformer_blocks.2.norm1 214 | down_blocks.2.attentions.0.transformer_blocks.2.attn1 215 | down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_q 216 | down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_k 217 | down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_v 218 | down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_out 219 | down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_out.0 220 | down_blocks.2.attentions.0.transformer_blocks.2.attn1.to_out.1 221 | down_blocks.2.attentions.0.transformer_blocks.2.norm2 222 | down_blocks.2.attentions.0.transformer_blocks.2.attn2 223 | down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_q 224 | down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_k 225 | down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_v 226 | down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_out 227 | down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_out.0 228 | down_blocks.2.attentions.0.transformer_blocks.2.attn2.to_out.1 229 | down_blocks.2.attentions.0.transformer_blocks.2.norm3 230 | down_blocks.2.attentions.0.transformer_blocks.2.ff 231 | down_blocks.2.attentions.0.transformer_blocks.2.ff.net 232 | down_blocks.2.attentions.0.transformer_blocks.2.ff.net.0 233 | down_blocks.2.attentions.0.transformer_blocks.2.ff.net.0.proj 234 | down_blocks.2.attentions.0.transformer_blocks.2.ff.net.1 235 | down_blocks.2.attentions.0.transformer_blocks.2.ff.net.2 236 | down_blocks.2.attentions.0.transformer_blocks.3 237 | down_blocks.2.attentions.0.transformer_blocks.3.norm1 238 | down_blocks.2.attentions.0.transformer_blocks.3.attn1 239 | down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_q 240 | down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_k 241 | down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_v 242 | down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_out 243 | down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_out.0 244 | down_blocks.2.attentions.0.transformer_blocks.3.attn1.to_out.1 245 | down_blocks.2.attentions.0.transformer_blocks.3.norm2 246 | down_blocks.2.attentions.0.transformer_blocks.3.attn2 247 | down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_q 248 | down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_k 249 | down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_v 250 | down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_out 251 | down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_out.0 252 | down_blocks.2.attentions.0.transformer_blocks.3.attn2.to_out.1 253 | down_blocks.2.attentions.0.transformer_blocks.3.norm3 254 | down_blocks.2.attentions.0.transformer_blocks.3.ff 255 | down_blocks.2.attentions.0.transformer_blocks.3.ff.net 256 | down_blocks.2.attentions.0.transformer_blocks.3.ff.net.0 257 | down_blocks.2.attentions.0.transformer_blocks.3.ff.net.0.proj 258 | down_blocks.2.attentions.0.transformer_blocks.3.ff.net.1 259 | down_blocks.2.attentions.0.transformer_blocks.3.ff.net.2 260 | down_blocks.2.attentions.0.transformer_blocks.4 261 | down_blocks.2.attentions.0.transformer_blocks.4.norm1 262 | down_blocks.2.attentions.0.transformer_blocks.4.attn1 263 | down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_q 264 | down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_k 265 | down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_v 266 | down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_out 267 | down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_out.0 268 | down_blocks.2.attentions.0.transformer_blocks.4.attn1.to_out.1 269 | down_blocks.2.attentions.0.transformer_blocks.4.norm2 270 | down_blocks.2.attentions.0.transformer_blocks.4.attn2 271 | down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_q 272 | down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_k 273 | down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_v 274 | down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_out 275 | down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_out.0 276 | down_blocks.2.attentions.0.transformer_blocks.4.attn2.to_out.1 277 | down_blocks.2.attentions.0.transformer_blocks.4.norm3 278 | down_blocks.2.attentions.0.transformer_blocks.4.ff 279 | down_blocks.2.attentions.0.transformer_blocks.4.ff.net 280 | down_blocks.2.attentions.0.transformer_blocks.4.ff.net.0 281 | down_blocks.2.attentions.0.transformer_blocks.4.ff.net.0.proj 282 | down_blocks.2.attentions.0.transformer_blocks.4.ff.net.1 283 | down_blocks.2.attentions.0.transformer_blocks.4.ff.net.2 284 | down_blocks.2.attentions.0.transformer_blocks.5 285 | down_blocks.2.attentions.0.transformer_blocks.5.norm1 286 | down_blocks.2.attentions.0.transformer_blocks.5.attn1 287 | down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_q 288 | down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_k 289 | down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_v 290 | down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_out 291 | down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_out.0 292 | down_blocks.2.attentions.0.transformer_blocks.5.attn1.to_out.1 293 | down_blocks.2.attentions.0.transformer_blocks.5.norm2 294 | down_blocks.2.attentions.0.transformer_blocks.5.attn2 295 | down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_q 296 | down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_k 297 | down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_v 298 | down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_out 299 | down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_out.0 300 | down_blocks.2.attentions.0.transformer_blocks.5.attn2.to_out.1 301 | down_blocks.2.attentions.0.transformer_blocks.5.norm3 302 | down_blocks.2.attentions.0.transformer_blocks.5.ff 303 | down_blocks.2.attentions.0.transformer_blocks.5.ff.net 304 | down_blocks.2.attentions.0.transformer_blocks.5.ff.net.0 305 | down_blocks.2.attentions.0.transformer_blocks.5.ff.net.0.proj 306 | down_blocks.2.attentions.0.transformer_blocks.5.ff.net.1 307 | down_blocks.2.attentions.0.transformer_blocks.5.ff.net.2 308 | down_blocks.2.attentions.0.transformer_blocks.6 309 | down_blocks.2.attentions.0.transformer_blocks.6.norm1 310 | down_blocks.2.attentions.0.transformer_blocks.6.attn1 311 | down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_q 312 | down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_k 313 | down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_v 314 | down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_out 315 | down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_out.0 316 | down_blocks.2.attentions.0.transformer_blocks.6.attn1.to_out.1 317 | down_blocks.2.attentions.0.transformer_blocks.6.norm2 318 | down_blocks.2.attentions.0.transformer_blocks.6.attn2 319 | down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_q 320 | down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_k 321 | down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_v 322 | down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_out 323 | down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_out.0 324 | down_blocks.2.attentions.0.transformer_blocks.6.attn2.to_out.1 325 | down_blocks.2.attentions.0.transformer_blocks.6.norm3 326 | down_blocks.2.attentions.0.transformer_blocks.6.ff 327 | down_blocks.2.attentions.0.transformer_blocks.6.ff.net 328 | down_blocks.2.attentions.0.transformer_blocks.6.ff.net.0 329 | down_blocks.2.attentions.0.transformer_blocks.6.ff.net.0.proj 330 | down_blocks.2.attentions.0.transformer_blocks.6.ff.net.1 331 | down_blocks.2.attentions.0.transformer_blocks.6.ff.net.2 332 | down_blocks.2.attentions.0.transformer_blocks.7 333 | down_blocks.2.attentions.0.transformer_blocks.7.norm1 334 | down_blocks.2.attentions.0.transformer_blocks.7.attn1 335 | down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_q 336 | down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_k 337 | down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_v 338 | down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_out 339 | down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_out.0 340 | down_blocks.2.attentions.0.transformer_blocks.7.attn1.to_out.1 341 | down_blocks.2.attentions.0.transformer_blocks.7.norm2 342 | down_blocks.2.attentions.0.transformer_blocks.7.attn2 343 | down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_q 344 | down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_k 345 | down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_v 346 | down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_out 347 | down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_out.0 348 | down_blocks.2.attentions.0.transformer_blocks.7.attn2.to_out.1 349 | down_blocks.2.attentions.0.transformer_blocks.7.norm3 350 | down_blocks.2.attentions.0.transformer_blocks.7.ff 351 | down_blocks.2.attentions.0.transformer_blocks.7.ff.net 352 | down_blocks.2.attentions.0.transformer_blocks.7.ff.net.0 353 | down_blocks.2.attentions.0.transformer_blocks.7.ff.net.0.proj 354 | down_blocks.2.attentions.0.transformer_blocks.7.ff.net.1 355 | down_blocks.2.attentions.0.transformer_blocks.7.ff.net.2 356 | down_blocks.2.attentions.0.transformer_blocks.8 357 | down_blocks.2.attentions.0.transformer_blocks.8.norm1 358 | down_blocks.2.attentions.0.transformer_blocks.8.attn1 359 | down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_q 360 | down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_k 361 | down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_v 362 | down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_out 363 | down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_out.0 364 | down_blocks.2.attentions.0.transformer_blocks.8.attn1.to_out.1 365 | down_blocks.2.attentions.0.transformer_blocks.8.norm2 366 | down_blocks.2.attentions.0.transformer_blocks.8.attn2 367 | down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_q 368 | down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_k 369 | down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_v 370 | down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_out 371 | down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_out.0 372 | down_blocks.2.attentions.0.transformer_blocks.8.attn2.to_out.1 373 | down_blocks.2.attentions.0.transformer_blocks.8.norm3 374 | down_blocks.2.attentions.0.transformer_blocks.8.ff 375 | down_blocks.2.attentions.0.transformer_blocks.8.ff.net 376 | down_blocks.2.attentions.0.transformer_blocks.8.ff.net.0 377 | down_blocks.2.attentions.0.transformer_blocks.8.ff.net.0.proj 378 | down_blocks.2.attentions.0.transformer_blocks.8.ff.net.1 379 | down_blocks.2.attentions.0.transformer_blocks.8.ff.net.2 380 | down_blocks.2.attentions.0.transformer_blocks.9 381 | down_blocks.2.attentions.0.transformer_blocks.9.norm1 382 | down_blocks.2.attentions.0.transformer_blocks.9.attn1 383 | down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_q 384 | down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_k 385 | down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_v 386 | down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_out 387 | down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_out.0 388 | down_blocks.2.attentions.0.transformer_blocks.9.attn1.to_out.1 389 | down_blocks.2.attentions.0.transformer_blocks.9.norm2 390 | down_blocks.2.attentions.0.transformer_blocks.9.attn2 391 | down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_q 392 | down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_k 393 | down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_v 394 | down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_out 395 | down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_out.0 396 | down_blocks.2.attentions.0.transformer_blocks.9.attn2.to_out.1 397 | down_blocks.2.attentions.0.transformer_blocks.9.norm3 398 | down_blocks.2.attentions.0.transformer_blocks.9.ff 399 | down_blocks.2.attentions.0.transformer_blocks.9.ff.net 400 | down_blocks.2.attentions.0.transformer_blocks.9.ff.net.0 401 | down_blocks.2.attentions.0.transformer_blocks.9.ff.net.0.proj 402 | down_blocks.2.attentions.0.transformer_blocks.9.ff.net.1 403 | down_blocks.2.attentions.0.transformer_blocks.9.ff.net.2 404 | down_blocks.2.attentions.0.proj_out 405 | down_blocks.2.attentions.1 406 | down_blocks.2.attentions.1.norm 407 | down_blocks.2.attentions.1.proj_in 408 | down_blocks.2.attentions.1.transformer_blocks 409 | down_blocks.2.attentions.1.transformer_blocks.0 410 | down_blocks.2.attentions.1.transformer_blocks.0.norm1 411 | down_blocks.2.attentions.1.transformer_blocks.0.attn1 412 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_q 413 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_k 414 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_v 415 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out 416 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out.0 417 | down_blocks.2.attentions.1.transformer_blocks.0.attn1.to_out.1 418 | down_blocks.2.attentions.1.transformer_blocks.0.norm2 419 | down_blocks.2.attentions.1.transformer_blocks.0.attn2 420 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_q 421 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_k 422 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_v 423 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out 424 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out.0 425 | down_blocks.2.attentions.1.transformer_blocks.0.attn2.to_out.1 426 | down_blocks.2.attentions.1.transformer_blocks.0.norm3 427 | down_blocks.2.attentions.1.transformer_blocks.0.ff 428 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net 429 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net.0 430 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net.0.proj 431 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net.1 432 | down_blocks.2.attentions.1.transformer_blocks.0.ff.net.2 433 | down_blocks.2.attentions.1.transformer_blocks.1 434 | down_blocks.2.attentions.1.transformer_blocks.1.norm1 435 | down_blocks.2.attentions.1.transformer_blocks.1.attn1 436 | down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_q 437 | down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_k 438 | down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_v 439 | down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_out 440 | down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_out.0 441 | down_blocks.2.attentions.1.transformer_blocks.1.attn1.to_out.1 442 | down_blocks.2.attentions.1.transformer_blocks.1.norm2 443 | down_blocks.2.attentions.1.transformer_blocks.1.attn2 444 | down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_q 445 | down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_k 446 | down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_v 447 | down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_out 448 | down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_out.0 449 | down_blocks.2.attentions.1.transformer_blocks.1.attn2.to_out.1 450 | down_blocks.2.attentions.1.transformer_blocks.1.norm3 451 | down_blocks.2.attentions.1.transformer_blocks.1.ff 452 | down_blocks.2.attentions.1.transformer_blocks.1.ff.net 453 | down_blocks.2.attentions.1.transformer_blocks.1.ff.net.0 454 | down_blocks.2.attentions.1.transformer_blocks.1.ff.net.0.proj 455 | down_blocks.2.attentions.1.transformer_blocks.1.ff.net.1 456 | down_blocks.2.attentions.1.transformer_blocks.1.ff.net.2 457 | down_blocks.2.attentions.1.transformer_blocks.2 458 | down_blocks.2.attentions.1.transformer_blocks.2.norm1 459 | down_blocks.2.attentions.1.transformer_blocks.2.attn1 460 | down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_q 461 | down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_k 462 | down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_v 463 | down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_out 464 | down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_out.0 465 | down_blocks.2.attentions.1.transformer_blocks.2.attn1.to_out.1 466 | down_blocks.2.attentions.1.transformer_blocks.2.norm2 467 | down_blocks.2.attentions.1.transformer_blocks.2.attn2 468 | down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_q 469 | down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_k 470 | down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_v 471 | down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_out 472 | down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_out.0 473 | down_blocks.2.attentions.1.transformer_blocks.2.attn2.to_out.1 474 | down_blocks.2.attentions.1.transformer_blocks.2.norm3 475 | down_blocks.2.attentions.1.transformer_blocks.2.ff 476 | down_blocks.2.attentions.1.transformer_blocks.2.ff.net 477 | down_blocks.2.attentions.1.transformer_blocks.2.ff.net.0 478 | down_blocks.2.attentions.1.transformer_blocks.2.ff.net.0.proj 479 | down_blocks.2.attentions.1.transformer_blocks.2.ff.net.1 480 | down_blocks.2.attentions.1.transformer_blocks.2.ff.net.2 481 | down_blocks.2.attentions.1.transformer_blocks.3 482 | down_blocks.2.attentions.1.transformer_blocks.3.norm1 483 | down_blocks.2.attentions.1.transformer_blocks.3.attn1 484 | down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_q 485 | down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_k 486 | down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_v 487 | down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_out 488 | down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_out.0 489 | down_blocks.2.attentions.1.transformer_blocks.3.attn1.to_out.1 490 | down_blocks.2.attentions.1.transformer_blocks.3.norm2 491 | down_blocks.2.attentions.1.transformer_blocks.3.attn2 492 | down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_q 493 | down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_k 494 | down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_v 495 | down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_out 496 | down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_out.0 497 | down_blocks.2.attentions.1.transformer_blocks.3.attn2.to_out.1 498 | down_blocks.2.attentions.1.transformer_blocks.3.norm3 499 | down_blocks.2.attentions.1.transformer_blocks.3.ff 500 | down_blocks.2.attentions.1.transformer_blocks.3.ff.net 501 | down_blocks.2.attentions.1.transformer_blocks.3.ff.net.0 502 | down_blocks.2.attentions.1.transformer_blocks.3.ff.net.0.proj 503 | down_blocks.2.attentions.1.transformer_blocks.3.ff.net.1 504 | down_blocks.2.attentions.1.transformer_blocks.3.ff.net.2 505 | down_blocks.2.attentions.1.transformer_blocks.4 506 | down_blocks.2.attentions.1.transformer_blocks.4.norm1 507 | down_blocks.2.attentions.1.transformer_blocks.4.attn1 508 | down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_q 509 | down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_k 510 | down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_v 511 | down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_out 512 | down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_out.0 513 | down_blocks.2.attentions.1.transformer_blocks.4.attn1.to_out.1 514 | down_blocks.2.attentions.1.transformer_blocks.4.norm2 515 | down_blocks.2.attentions.1.transformer_blocks.4.attn2 516 | down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_q 517 | down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_k 518 | down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_v 519 | down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_out 520 | down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_out.0 521 | down_blocks.2.attentions.1.transformer_blocks.4.attn2.to_out.1 522 | down_blocks.2.attentions.1.transformer_blocks.4.norm3 523 | down_blocks.2.attentions.1.transformer_blocks.4.ff 524 | down_blocks.2.attentions.1.transformer_blocks.4.ff.net 525 | down_blocks.2.attentions.1.transformer_blocks.4.ff.net.0 526 | down_blocks.2.attentions.1.transformer_blocks.4.ff.net.0.proj 527 | down_blocks.2.attentions.1.transformer_blocks.4.ff.net.1 528 | down_blocks.2.attentions.1.transformer_blocks.4.ff.net.2 529 | down_blocks.2.attentions.1.transformer_blocks.5 530 | down_blocks.2.attentions.1.transformer_blocks.5.norm1 531 | down_blocks.2.attentions.1.transformer_blocks.5.attn1 532 | down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_q 533 | down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_k 534 | down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_v 535 | down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_out 536 | down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_out.0 537 | down_blocks.2.attentions.1.transformer_blocks.5.attn1.to_out.1 538 | down_blocks.2.attentions.1.transformer_blocks.5.norm2 539 | down_blocks.2.attentions.1.transformer_blocks.5.attn2 540 | down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_q 541 | down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_k 542 | down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_v 543 | down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_out 544 | down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_out.0 545 | down_blocks.2.attentions.1.transformer_blocks.5.attn2.to_out.1 546 | down_blocks.2.attentions.1.transformer_blocks.5.norm3 547 | down_blocks.2.attentions.1.transformer_blocks.5.ff 548 | down_blocks.2.attentions.1.transformer_blocks.5.ff.net 549 | down_blocks.2.attentions.1.transformer_blocks.5.ff.net.0 550 | down_blocks.2.attentions.1.transformer_blocks.5.ff.net.0.proj 551 | down_blocks.2.attentions.1.transformer_blocks.5.ff.net.1 552 | down_blocks.2.attentions.1.transformer_blocks.5.ff.net.2 553 | down_blocks.2.attentions.1.transformer_blocks.6 554 | down_blocks.2.attentions.1.transformer_blocks.6.norm1 555 | down_blocks.2.attentions.1.transformer_blocks.6.attn1 556 | down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_q 557 | down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_k 558 | down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_v 559 | down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_out 560 | down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_out.0 561 | down_blocks.2.attentions.1.transformer_blocks.6.attn1.to_out.1 562 | down_blocks.2.attentions.1.transformer_blocks.6.norm2 563 | down_blocks.2.attentions.1.transformer_blocks.6.attn2 564 | down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_q 565 | down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_k 566 | down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_v 567 | down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_out 568 | down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_out.0 569 | down_blocks.2.attentions.1.transformer_blocks.6.attn2.to_out.1 570 | down_blocks.2.attentions.1.transformer_blocks.6.norm3 571 | down_blocks.2.attentions.1.transformer_blocks.6.ff 572 | down_blocks.2.attentions.1.transformer_blocks.6.ff.net 573 | down_blocks.2.attentions.1.transformer_blocks.6.ff.net.0 574 | down_blocks.2.attentions.1.transformer_blocks.6.ff.net.0.proj 575 | down_blocks.2.attentions.1.transformer_blocks.6.ff.net.1 576 | down_blocks.2.attentions.1.transformer_blocks.6.ff.net.2 577 | down_blocks.2.attentions.1.transformer_blocks.7 578 | down_blocks.2.attentions.1.transformer_blocks.7.norm1 579 | down_blocks.2.attentions.1.transformer_blocks.7.attn1 580 | down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_q 581 | down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_k 582 | down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_v 583 | down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_out 584 | down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_out.0 585 | down_blocks.2.attentions.1.transformer_blocks.7.attn1.to_out.1 586 | down_blocks.2.attentions.1.transformer_blocks.7.norm2 587 | down_blocks.2.attentions.1.transformer_blocks.7.attn2 588 | down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_q 589 | down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_k 590 | down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_v 591 | down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_out 592 | down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_out.0 593 | down_blocks.2.attentions.1.transformer_blocks.7.attn2.to_out.1 594 | down_blocks.2.attentions.1.transformer_blocks.7.norm3 595 | down_blocks.2.attentions.1.transformer_blocks.7.ff 596 | down_blocks.2.attentions.1.transformer_blocks.7.ff.net 597 | down_blocks.2.attentions.1.transformer_blocks.7.ff.net.0 598 | down_blocks.2.attentions.1.transformer_blocks.7.ff.net.0.proj 599 | down_blocks.2.attentions.1.transformer_blocks.7.ff.net.1 600 | down_blocks.2.attentions.1.transformer_blocks.7.ff.net.2 601 | down_blocks.2.attentions.1.transformer_blocks.8 602 | down_blocks.2.attentions.1.transformer_blocks.8.norm1 603 | down_blocks.2.attentions.1.transformer_blocks.8.attn1 604 | down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_q 605 | down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_k 606 | down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_v 607 | down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_out 608 | down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_out.0 609 | down_blocks.2.attentions.1.transformer_blocks.8.attn1.to_out.1 610 | down_blocks.2.attentions.1.transformer_blocks.8.norm2 611 | down_blocks.2.attentions.1.transformer_blocks.8.attn2 612 | down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_q 613 | down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_k 614 | down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_v 615 | down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_out 616 | down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_out.0 617 | down_blocks.2.attentions.1.transformer_blocks.8.attn2.to_out.1 618 | down_blocks.2.attentions.1.transformer_blocks.8.norm3 619 | down_blocks.2.attentions.1.transformer_blocks.8.ff 620 | down_blocks.2.attentions.1.transformer_blocks.8.ff.net 621 | down_blocks.2.attentions.1.transformer_blocks.8.ff.net.0 622 | down_blocks.2.attentions.1.transformer_blocks.8.ff.net.0.proj 623 | down_blocks.2.attentions.1.transformer_blocks.8.ff.net.1 624 | down_blocks.2.attentions.1.transformer_blocks.8.ff.net.2 625 | down_blocks.2.attentions.1.transformer_blocks.9 626 | down_blocks.2.attentions.1.transformer_blocks.9.norm1 627 | down_blocks.2.attentions.1.transformer_blocks.9.attn1 628 | down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_q 629 | down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_k 630 | down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_v 631 | down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_out 632 | down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_out.0 633 | down_blocks.2.attentions.1.transformer_blocks.9.attn1.to_out.1 634 | down_blocks.2.attentions.1.transformer_blocks.9.norm2 635 | down_blocks.2.attentions.1.transformer_blocks.9.attn2 636 | down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_q 637 | down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_k 638 | down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_v 639 | down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_out 640 | down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_out.0 641 | down_blocks.2.attentions.1.transformer_blocks.9.attn2.to_out.1 642 | down_blocks.2.attentions.1.transformer_blocks.9.norm3 643 | down_blocks.2.attentions.1.transformer_blocks.9.ff 644 | down_blocks.2.attentions.1.transformer_blocks.9.ff.net 645 | down_blocks.2.attentions.1.transformer_blocks.9.ff.net.0 646 | down_blocks.2.attentions.1.transformer_blocks.9.ff.net.0.proj 647 | down_blocks.2.attentions.1.transformer_blocks.9.ff.net.1 648 | down_blocks.2.attentions.1.transformer_blocks.9.ff.net.2 649 | down_blocks.2.attentions.1.proj_out 650 | down_blocks.2.resnets 651 | down_blocks.2.resnets.0 652 | down_blocks.2.resnets.0.norm1 653 | down_blocks.2.resnets.0.conv1 654 | down_blocks.2.resnets.0.time_emb_proj 655 | down_blocks.2.resnets.0.norm2 656 | down_blocks.2.resnets.0.dropout 657 | down_blocks.2.resnets.0.conv2 658 | down_blocks.2.resnets.0.conv_shortcut 659 | down_blocks.2.resnets.1 660 | down_blocks.2.resnets.1.norm1 661 | down_blocks.2.resnets.1.conv1 662 | down_blocks.2.resnets.1.time_emb_proj 663 | down_blocks.2.resnets.1.norm2 664 | down_blocks.2.resnets.1.dropout 665 | down_blocks.2.resnets.1.conv2 666 | up_blocks 667 | up_blocks.0 668 | up_blocks.0.attentions 669 | up_blocks.0.attentions.0 670 | up_blocks.0.attentions.0.norm 671 | up_blocks.0.attentions.0.proj_in 672 | up_blocks.0.attentions.0.transformer_blocks 673 | up_blocks.0.attentions.0.transformer_blocks.0 674 | up_blocks.0.attentions.0.transformer_blocks.0.norm1 675 | up_blocks.0.attentions.0.transformer_blocks.0.attn1 676 | up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_q 677 | up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_k 678 | up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_v 679 | up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_out 680 | up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_out.0 681 | up_blocks.0.attentions.0.transformer_blocks.0.attn1.to_out.1 682 | up_blocks.0.attentions.0.transformer_blocks.0.norm2 683 | up_blocks.0.attentions.0.transformer_blocks.0.attn2 684 | up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_q 685 | up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_k 686 | up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_v 687 | up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_out 688 | up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_out.0 689 | up_blocks.0.attentions.0.transformer_blocks.0.attn2.to_out.1 690 | up_blocks.0.attentions.0.transformer_blocks.0.norm3 691 | up_blocks.0.attentions.0.transformer_blocks.0.ff 692 | up_blocks.0.attentions.0.transformer_blocks.0.ff.net 693 | up_blocks.0.attentions.0.transformer_blocks.0.ff.net.0 694 | up_blocks.0.attentions.0.transformer_blocks.0.ff.net.0.proj 695 | up_blocks.0.attentions.0.transformer_blocks.0.ff.net.1 696 | up_blocks.0.attentions.0.transformer_blocks.0.ff.net.2 697 | up_blocks.0.attentions.0.transformer_blocks.1 698 | up_blocks.0.attentions.0.transformer_blocks.1.norm1 699 | up_blocks.0.attentions.0.transformer_blocks.1.attn1 700 | up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_q 701 | up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_k 702 | up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_v 703 | up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_out 704 | up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_out.0 705 | up_blocks.0.attentions.0.transformer_blocks.1.attn1.to_out.1 706 | up_blocks.0.attentions.0.transformer_blocks.1.norm2 707 | up_blocks.0.attentions.0.transformer_blocks.1.attn2 708 | up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_q 709 | up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_k 710 | up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_v 711 | up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_out 712 | up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_out.0 713 | up_blocks.0.attentions.0.transformer_blocks.1.attn2.to_out.1 714 | up_blocks.0.attentions.0.transformer_blocks.1.norm3 715 | up_blocks.0.attentions.0.transformer_blocks.1.ff 716 | up_blocks.0.attentions.0.transformer_blocks.1.ff.net 717 | up_blocks.0.attentions.0.transformer_blocks.1.ff.net.0 718 | up_blocks.0.attentions.0.transformer_blocks.1.ff.net.0.proj 719 | up_blocks.0.attentions.0.transformer_blocks.1.ff.net.1 720 | up_blocks.0.attentions.0.transformer_blocks.1.ff.net.2 721 | up_blocks.0.attentions.0.transformer_blocks.2 722 | up_blocks.0.attentions.0.transformer_blocks.2.norm1 723 | up_blocks.0.attentions.0.transformer_blocks.2.attn1 724 | up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_q 725 | up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_k 726 | up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_v 727 | up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_out 728 | up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_out.0 729 | up_blocks.0.attentions.0.transformer_blocks.2.attn1.to_out.1 730 | up_blocks.0.attentions.0.transformer_blocks.2.norm2 731 | up_blocks.0.attentions.0.transformer_blocks.2.attn2 732 | up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_q 733 | up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_k 734 | up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_v 735 | up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_out 736 | up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_out.0 737 | up_blocks.0.attentions.0.transformer_blocks.2.attn2.to_out.1 738 | up_blocks.0.attentions.0.transformer_blocks.2.norm3 739 | up_blocks.0.attentions.0.transformer_blocks.2.ff 740 | up_blocks.0.attentions.0.transformer_blocks.2.ff.net 741 | up_blocks.0.attentions.0.transformer_blocks.2.ff.net.0 742 | up_blocks.0.attentions.0.transformer_blocks.2.ff.net.0.proj 743 | up_blocks.0.attentions.0.transformer_blocks.2.ff.net.1 744 | up_blocks.0.attentions.0.transformer_blocks.2.ff.net.2 745 | up_blocks.0.attentions.0.transformer_blocks.3 746 | up_blocks.0.attentions.0.transformer_blocks.3.norm1 747 | up_blocks.0.attentions.0.transformer_blocks.3.attn1 748 | up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_q 749 | up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_k 750 | up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_v 751 | up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_out 752 | up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_out.0 753 | up_blocks.0.attentions.0.transformer_blocks.3.attn1.to_out.1 754 | up_blocks.0.attentions.0.transformer_blocks.3.norm2 755 | up_blocks.0.attentions.0.transformer_blocks.3.attn2 756 | up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_q 757 | up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_k 758 | up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_v 759 | up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_out 760 | up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_out.0 761 | up_blocks.0.attentions.0.transformer_blocks.3.attn2.to_out.1 762 | up_blocks.0.attentions.0.transformer_blocks.3.norm3 763 | up_blocks.0.attentions.0.transformer_blocks.3.ff 764 | up_blocks.0.attentions.0.transformer_blocks.3.ff.net 765 | up_blocks.0.attentions.0.transformer_blocks.3.ff.net.0 766 | up_blocks.0.attentions.0.transformer_blocks.3.ff.net.0.proj 767 | up_blocks.0.attentions.0.transformer_blocks.3.ff.net.1 768 | up_blocks.0.attentions.0.transformer_blocks.3.ff.net.2 769 | up_blocks.0.attentions.0.transformer_blocks.4 770 | up_blocks.0.attentions.0.transformer_blocks.4.norm1 771 | up_blocks.0.attentions.0.transformer_blocks.4.attn1 772 | up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_q 773 | up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_k 774 | up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_v 775 | up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_out 776 | up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_out.0 777 | up_blocks.0.attentions.0.transformer_blocks.4.attn1.to_out.1 778 | up_blocks.0.attentions.0.transformer_blocks.4.norm2 779 | up_blocks.0.attentions.0.transformer_blocks.4.attn2 780 | up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_q 781 | up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_k 782 | up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_v 783 | up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_out 784 | up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_out.0 785 | up_blocks.0.attentions.0.transformer_blocks.4.attn2.to_out.1 786 | up_blocks.0.attentions.0.transformer_blocks.4.norm3 787 | up_blocks.0.attentions.0.transformer_blocks.4.ff 788 | up_blocks.0.attentions.0.transformer_blocks.4.ff.net 789 | up_blocks.0.attentions.0.transformer_blocks.4.ff.net.0 790 | up_blocks.0.attentions.0.transformer_blocks.4.ff.net.0.proj 791 | up_blocks.0.attentions.0.transformer_blocks.4.ff.net.1 792 | up_blocks.0.attentions.0.transformer_blocks.4.ff.net.2 793 | up_blocks.0.attentions.0.transformer_blocks.5 794 | up_blocks.0.attentions.0.transformer_blocks.5.norm1 795 | up_blocks.0.attentions.0.transformer_blocks.5.attn1 796 | up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_q 797 | up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_k 798 | up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_v 799 | up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_out 800 | up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_out.0 801 | up_blocks.0.attentions.0.transformer_blocks.5.attn1.to_out.1 802 | up_blocks.0.attentions.0.transformer_blocks.5.norm2 803 | up_blocks.0.attentions.0.transformer_blocks.5.attn2 804 | up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_q 805 | up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_k 806 | up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_v 807 | up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_out 808 | up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_out.0 809 | up_blocks.0.attentions.0.transformer_blocks.5.attn2.to_out.1 810 | up_blocks.0.attentions.0.transformer_blocks.5.norm3 811 | up_blocks.0.attentions.0.transformer_blocks.5.ff 812 | up_blocks.0.attentions.0.transformer_blocks.5.ff.net 813 | up_blocks.0.attentions.0.transformer_blocks.5.ff.net.0 814 | up_blocks.0.attentions.0.transformer_blocks.5.ff.net.0.proj 815 | up_blocks.0.attentions.0.transformer_blocks.5.ff.net.1 816 | up_blocks.0.attentions.0.transformer_blocks.5.ff.net.2 817 | up_blocks.0.attentions.0.transformer_blocks.6 818 | up_blocks.0.attentions.0.transformer_blocks.6.norm1 819 | up_blocks.0.attentions.0.transformer_blocks.6.attn1 820 | up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_q 821 | up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_k 822 | up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_v 823 | up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_out 824 | up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_out.0 825 | up_blocks.0.attentions.0.transformer_blocks.6.attn1.to_out.1 826 | up_blocks.0.attentions.0.transformer_blocks.6.norm2 827 | up_blocks.0.attentions.0.transformer_blocks.6.attn2 828 | up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_q 829 | up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_k 830 | up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_v 831 | up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_out 832 | up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_out.0 833 | up_blocks.0.attentions.0.transformer_blocks.6.attn2.to_out.1 834 | up_blocks.0.attentions.0.transformer_blocks.6.norm3 835 | up_blocks.0.attentions.0.transformer_blocks.6.ff 836 | up_blocks.0.attentions.0.transformer_blocks.6.ff.net 837 | up_blocks.0.attentions.0.transformer_blocks.6.ff.net.0 838 | up_blocks.0.attentions.0.transformer_blocks.6.ff.net.0.proj 839 | up_blocks.0.attentions.0.transformer_blocks.6.ff.net.1 840 | up_blocks.0.attentions.0.transformer_blocks.6.ff.net.2 841 | up_blocks.0.attentions.0.transformer_blocks.7 842 | up_blocks.0.attentions.0.transformer_blocks.7.norm1 843 | up_blocks.0.attentions.0.transformer_blocks.7.attn1 844 | up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_q 845 | up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_k 846 | up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_v 847 | up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_out 848 | up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_out.0 849 | up_blocks.0.attentions.0.transformer_blocks.7.attn1.to_out.1 850 | up_blocks.0.attentions.0.transformer_blocks.7.norm2 851 | up_blocks.0.attentions.0.transformer_blocks.7.attn2 852 | up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_q 853 | up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_k 854 | up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_v 855 | up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_out 856 | up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_out.0 857 | up_blocks.0.attentions.0.transformer_blocks.7.attn2.to_out.1 858 | up_blocks.0.attentions.0.transformer_blocks.7.norm3 859 | up_blocks.0.attentions.0.transformer_blocks.7.ff 860 | up_blocks.0.attentions.0.transformer_blocks.7.ff.net 861 | up_blocks.0.attentions.0.transformer_blocks.7.ff.net.0 862 | up_blocks.0.attentions.0.transformer_blocks.7.ff.net.0.proj 863 | up_blocks.0.attentions.0.transformer_blocks.7.ff.net.1 864 | up_blocks.0.attentions.0.transformer_blocks.7.ff.net.2 865 | up_blocks.0.attentions.0.transformer_blocks.8 866 | up_blocks.0.attentions.0.transformer_blocks.8.norm1 867 | up_blocks.0.attentions.0.transformer_blocks.8.attn1 868 | up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_q 869 | up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_k 870 | up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_v 871 | up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_out 872 | up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_out.0 873 | up_blocks.0.attentions.0.transformer_blocks.8.attn1.to_out.1 874 | up_blocks.0.attentions.0.transformer_blocks.8.norm2 875 | up_blocks.0.attentions.0.transformer_blocks.8.attn2 876 | up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_q 877 | up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_k 878 | up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_v 879 | up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_out 880 | up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_out.0 881 | up_blocks.0.attentions.0.transformer_blocks.8.attn2.to_out.1 882 | up_blocks.0.attentions.0.transformer_blocks.8.norm3 883 | up_blocks.0.attentions.0.transformer_blocks.8.ff 884 | up_blocks.0.attentions.0.transformer_blocks.8.ff.net 885 | up_blocks.0.attentions.0.transformer_blocks.8.ff.net.0 886 | up_blocks.0.attentions.0.transformer_blocks.8.ff.net.0.proj 887 | up_blocks.0.attentions.0.transformer_blocks.8.ff.net.1 888 | up_blocks.0.attentions.0.transformer_blocks.8.ff.net.2 889 | up_blocks.0.attentions.0.transformer_blocks.9 890 | up_blocks.0.attentions.0.transformer_blocks.9.norm1 891 | up_blocks.0.attentions.0.transformer_blocks.9.attn1 892 | up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_q 893 | up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_k 894 | up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_v 895 | up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_out 896 | up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_out.0 897 | up_blocks.0.attentions.0.transformer_blocks.9.attn1.to_out.1 898 | up_blocks.0.attentions.0.transformer_blocks.9.norm2 899 | up_blocks.0.attentions.0.transformer_blocks.9.attn2 900 | up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_q 901 | up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_k 902 | up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_v 903 | up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_out 904 | up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_out.0 905 | up_blocks.0.attentions.0.transformer_blocks.9.attn2.to_out.1 906 | up_blocks.0.attentions.0.transformer_blocks.9.norm3 907 | up_blocks.0.attentions.0.transformer_blocks.9.ff 908 | up_blocks.0.attentions.0.transformer_blocks.9.ff.net 909 | up_blocks.0.attentions.0.transformer_blocks.9.ff.net.0 910 | up_blocks.0.attentions.0.transformer_blocks.9.ff.net.0.proj 911 | up_blocks.0.attentions.0.transformer_blocks.9.ff.net.1 912 | up_blocks.0.attentions.0.transformer_blocks.9.ff.net.2 913 | up_blocks.0.attentions.0.proj_out 914 | up_blocks.0.attentions.1 915 | up_blocks.0.attentions.1.norm 916 | up_blocks.0.attentions.1.proj_in 917 | up_blocks.0.attentions.1.transformer_blocks 918 | up_blocks.0.attentions.1.transformer_blocks.0 919 | up_blocks.0.attentions.1.transformer_blocks.0.norm1 920 | up_blocks.0.attentions.1.transformer_blocks.0.attn1 921 | up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_q 922 | up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_k 923 | up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_v 924 | up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_out 925 | up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_out.0 926 | up_blocks.0.attentions.1.transformer_blocks.0.attn1.to_out.1 927 | up_blocks.0.attentions.1.transformer_blocks.0.norm2 928 | up_blocks.0.attentions.1.transformer_blocks.0.attn2 929 | up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_q 930 | up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_k 931 | up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_v 932 | up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_out 933 | up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_out.0 934 | up_blocks.0.attentions.1.transformer_blocks.0.attn2.to_out.1 935 | up_blocks.0.attentions.1.transformer_blocks.0.norm3 936 | up_blocks.0.attentions.1.transformer_blocks.0.ff 937 | up_blocks.0.attentions.1.transformer_blocks.0.ff.net 938 | up_blocks.0.attentions.1.transformer_blocks.0.ff.net.0 939 | up_blocks.0.attentions.1.transformer_blocks.0.ff.net.0.proj 940 | up_blocks.0.attentions.1.transformer_blocks.0.ff.net.1 941 | up_blocks.0.attentions.1.transformer_blocks.0.ff.net.2 942 | up_blocks.0.attentions.1.transformer_blocks.1 943 | up_blocks.0.attentions.1.transformer_blocks.1.norm1 944 | up_blocks.0.attentions.1.transformer_blocks.1.attn1 945 | up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_q 946 | up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_k 947 | up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_v 948 | up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_out 949 | up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_out.0 950 | up_blocks.0.attentions.1.transformer_blocks.1.attn1.to_out.1 951 | up_blocks.0.attentions.1.transformer_blocks.1.norm2 952 | up_blocks.0.attentions.1.transformer_blocks.1.attn2 953 | up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_q 954 | up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_k 955 | up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_v 956 | up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_out 957 | up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_out.0 958 | up_blocks.0.attentions.1.transformer_blocks.1.attn2.to_out.1 959 | up_blocks.0.attentions.1.transformer_blocks.1.norm3 960 | up_blocks.0.attentions.1.transformer_blocks.1.ff 961 | up_blocks.0.attentions.1.transformer_blocks.1.ff.net 962 | up_blocks.0.attentions.1.transformer_blocks.1.ff.net.0 963 | up_blocks.0.attentions.1.transformer_blocks.1.ff.net.0.proj 964 | up_blocks.0.attentions.1.transformer_blocks.1.ff.net.1 965 | up_blocks.0.attentions.1.transformer_blocks.1.ff.net.2 966 | up_blocks.0.attentions.1.transformer_blocks.2 967 | up_blocks.0.attentions.1.transformer_blocks.2.norm1 968 | up_blocks.0.attentions.1.transformer_blocks.2.attn1 969 | up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_q 970 | up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_k 971 | up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_v 972 | up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_out 973 | up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_out.0 974 | up_blocks.0.attentions.1.transformer_blocks.2.attn1.to_out.1 975 | up_blocks.0.attentions.1.transformer_blocks.2.norm2 976 | up_blocks.0.attentions.1.transformer_blocks.2.attn2 977 | up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_q 978 | up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_k 979 | up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_v 980 | up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_out 981 | up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_out.0 982 | up_blocks.0.attentions.1.transformer_blocks.2.attn2.to_out.1 983 | up_blocks.0.attentions.1.transformer_blocks.2.norm3 984 | up_blocks.0.attentions.1.transformer_blocks.2.ff 985 | up_blocks.0.attentions.1.transformer_blocks.2.ff.net 986 | up_blocks.0.attentions.1.transformer_blocks.2.ff.net.0 987 | up_blocks.0.attentions.1.transformer_blocks.2.ff.net.0.proj 988 | up_blocks.0.attentions.1.transformer_blocks.2.ff.net.1 989 | up_blocks.0.attentions.1.transformer_blocks.2.ff.net.2 990 | up_blocks.0.attentions.1.transformer_blocks.3 991 | up_blocks.0.attentions.1.transformer_blocks.3.norm1 992 | up_blocks.0.attentions.1.transformer_blocks.3.attn1 993 | up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_q 994 | up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_k 995 | up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_v 996 | up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_out 997 | up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_out.0 998 | up_blocks.0.attentions.1.transformer_blocks.3.attn1.to_out.1 999 | up_blocks.0.attentions.1.transformer_blocks.3.norm2 1000 | up_blocks.0.attentions.1.transformer_blocks.3.attn2 1001 | up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_q 1002 | up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_k 1003 | up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_v 1004 | up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_out 1005 | up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_out.0 1006 | up_blocks.0.attentions.1.transformer_blocks.3.attn2.to_out.1 1007 | up_blocks.0.attentions.1.transformer_blocks.3.norm3 1008 | up_blocks.0.attentions.1.transformer_blocks.3.ff 1009 | up_blocks.0.attentions.1.transformer_blocks.3.ff.net 1010 | up_blocks.0.attentions.1.transformer_blocks.3.ff.net.0 1011 | up_blocks.0.attentions.1.transformer_blocks.3.ff.net.0.proj 1012 | up_blocks.0.attentions.1.transformer_blocks.3.ff.net.1 1013 | up_blocks.0.attentions.1.transformer_blocks.3.ff.net.2 1014 | up_blocks.0.attentions.1.transformer_blocks.4 1015 | up_blocks.0.attentions.1.transformer_blocks.4.norm1 1016 | up_blocks.0.attentions.1.transformer_blocks.4.attn1 1017 | up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_q 1018 | up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_k 1019 | up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_v 1020 | up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_out 1021 | up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_out.0 1022 | up_blocks.0.attentions.1.transformer_blocks.4.attn1.to_out.1 1023 | up_blocks.0.attentions.1.transformer_blocks.4.norm2 1024 | up_blocks.0.attentions.1.transformer_blocks.4.attn2 1025 | up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_q 1026 | up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_k 1027 | up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_v 1028 | up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_out 1029 | up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_out.0 1030 | up_blocks.0.attentions.1.transformer_blocks.4.attn2.to_out.1 1031 | up_blocks.0.attentions.1.transformer_blocks.4.norm3 1032 | up_blocks.0.attentions.1.transformer_blocks.4.ff 1033 | up_blocks.0.attentions.1.transformer_blocks.4.ff.net 1034 | up_blocks.0.attentions.1.transformer_blocks.4.ff.net.0 1035 | up_blocks.0.attentions.1.transformer_blocks.4.ff.net.0.proj 1036 | up_blocks.0.attentions.1.transformer_blocks.4.ff.net.1 1037 | up_blocks.0.attentions.1.transformer_blocks.4.ff.net.2 1038 | up_blocks.0.attentions.1.transformer_blocks.5 1039 | up_blocks.0.attentions.1.transformer_blocks.5.norm1 1040 | up_blocks.0.attentions.1.transformer_blocks.5.attn1 1041 | up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_q 1042 | up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_k 1043 | up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_v 1044 | up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_out 1045 | up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_out.0 1046 | up_blocks.0.attentions.1.transformer_blocks.5.attn1.to_out.1 1047 | up_blocks.0.attentions.1.transformer_blocks.5.norm2 1048 | up_blocks.0.attentions.1.transformer_blocks.5.attn2 1049 | up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_q 1050 | up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_k 1051 | up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_v 1052 | up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_out 1053 | up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_out.0 1054 | up_blocks.0.attentions.1.transformer_blocks.5.attn2.to_out.1 1055 | up_blocks.0.attentions.1.transformer_blocks.5.norm3 1056 | up_blocks.0.attentions.1.transformer_blocks.5.ff 1057 | up_blocks.0.attentions.1.transformer_blocks.5.ff.net 1058 | up_blocks.0.attentions.1.transformer_blocks.5.ff.net.0 1059 | up_blocks.0.attentions.1.transformer_blocks.5.ff.net.0.proj 1060 | up_blocks.0.attentions.1.transformer_blocks.5.ff.net.1 1061 | up_blocks.0.attentions.1.transformer_blocks.5.ff.net.2 1062 | up_blocks.0.attentions.1.transformer_blocks.6 1063 | up_blocks.0.attentions.1.transformer_blocks.6.norm1 1064 | up_blocks.0.attentions.1.transformer_blocks.6.attn1 1065 | up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_q 1066 | up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_k 1067 | up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_v 1068 | up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_out 1069 | up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_out.0 1070 | up_blocks.0.attentions.1.transformer_blocks.6.attn1.to_out.1 1071 | up_blocks.0.attentions.1.transformer_blocks.6.norm2 1072 | up_blocks.0.attentions.1.transformer_blocks.6.attn2 1073 | up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_q 1074 | up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_k 1075 | up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_v 1076 | up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_out 1077 | up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_out.0 1078 | up_blocks.0.attentions.1.transformer_blocks.6.attn2.to_out.1 1079 | up_blocks.0.attentions.1.transformer_blocks.6.norm3 1080 | up_blocks.0.attentions.1.transformer_blocks.6.ff 1081 | up_blocks.0.attentions.1.transformer_blocks.6.ff.net 1082 | up_blocks.0.attentions.1.transformer_blocks.6.ff.net.0 1083 | up_blocks.0.attentions.1.transformer_blocks.6.ff.net.0.proj 1084 | up_blocks.0.attentions.1.transformer_blocks.6.ff.net.1 1085 | up_blocks.0.attentions.1.transformer_blocks.6.ff.net.2 1086 | up_blocks.0.attentions.1.transformer_blocks.7 1087 | up_blocks.0.attentions.1.transformer_blocks.7.norm1 1088 | up_blocks.0.attentions.1.transformer_blocks.7.attn1 1089 | up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_q 1090 | up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_k 1091 | up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_v 1092 | up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_out 1093 | up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_out.0 1094 | up_blocks.0.attentions.1.transformer_blocks.7.attn1.to_out.1 1095 | up_blocks.0.attentions.1.transformer_blocks.7.norm2 1096 | up_blocks.0.attentions.1.transformer_blocks.7.attn2 1097 | up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_q 1098 | up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_k 1099 | up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_v 1100 | up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_out 1101 | up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_out.0 1102 | up_blocks.0.attentions.1.transformer_blocks.7.attn2.to_out.1 1103 | up_blocks.0.attentions.1.transformer_blocks.7.norm3 1104 | up_blocks.0.attentions.1.transformer_blocks.7.ff 1105 | up_blocks.0.attentions.1.transformer_blocks.7.ff.net 1106 | up_blocks.0.attentions.1.transformer_blocks.7.ff.net.0 1107 | up_blocks.0.attentions.1.transformer_blocks.7.ff.net.0.proj 1108 | up_blocks.0.attentions.1.transformer_blocks.7.ff.net.1 1109 | up_blocks.0.attentions.1.transformer_blocks.7.ff.net.2 1110 | up_blocks.0.attentions.1.transformer_blocks.8 1111 | up_blocks.0.attentions.1.transformer_blocks.8.norm1 1112 | up_blocks.0.attentions.1.transformer_blocks.8.attn1 1113 | up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_q 1114 | up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_k 1115 | up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_v 1116 | up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_out 1117 | up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_out.0 1118 | up_blocks.0.attentions.1.transformer_blocks.8.attn1.to_out.1 1119 | up_blocks.0.attentions.1.transformer_blocks.8.norm2 1120 | up_blocks.0.attentions.1.transformer_blocks.8.attn2 1121 | up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_q 1122 | up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_k 1123 | up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_v 1124 | up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_out 1125 | up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_out.0 1126 | up_blocks.0.attentions.1.transformer_blocks.8.attn2.to_out.1 1127 | up_blocks.0.attentions.1.transformer_blocks.8.norm3 1128 | up_blocks.0.attentions.1.transformer_blocks.8.ff 1129 | up_blocks.0.attentions.1.transformer_blocks.8.ff.net 1130 | up_blocks.0.attentions.1.transformer_blocks.8.ff.net.0 1131 | up_blocks.0.attentions.1.transformer_blocks.8.ff.net.0.proj 1132 | up_blocks.0.attentions.1.transformer_blocks.8.ff.net.1 1133 | up_blocks.0.attentions.1.transformer_blocks.8.ff.net.2 1134 | up_blocks.0.attentions.1.transformer_blocks.9 1135 | up_blocks.0.attentions.1.transformer_blocks.9.norm1 1136 | up_blocks.0.attentions.1.transformer_blocks.9.attn1 1137 | up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_q 1138 | up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_k 1139 | up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_v 1140 | up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_out 1141 | up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_out.0 1142 | up_blocks.0.attentions.1.transformer_blocks.9.attn1.to_out.1 1143 | up_blocks.0.attentions.1.transformer_blocks.9.norm2 1144 | up_blocks.0.attentions.1.transformer_blocks.9.attn2 1145 | up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_q 1146 | up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_k 1147 | up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_v 1148 | up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_out 1149 | up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_out.0 1150 | up_blocks.0.attentions.1.transformer_blocks.9.attn2.to_out.1 1151 | up_blocks.0.attentions.1.transformer_blocks.9.norm3 1152 | up_blocks.0.attentions.1.transformer_blocks.9.ff 1153 | up_blocks.0.attentions.1.transformer_blocks.9.ff.net 1154 | up_blocks.0.attentions.1.transformer_blocks.9.ff.net.0 1155 | up_blocks.0.attentions.1.transformer_blocks.9.ff.net.0.proj 1156 | up_blocks.0.attentions.1.transformer_blocks.9.ff.net.1 1157 | up_blocks.0.attentions.1.transformer_blocks.9.ff.net.2 1158 | up_blocks.0.attentions.1.proj_out 1159 | up_blocks.0.attentions.2 1160 | up_blocks.0.attentions.2.norm 1161 | up_blocks.0.attentions.2.proj_in 1162 | up_blocks.0.attentions.2.transformer_blocks 1163 | up_blocks.0.attentions.2.transformer_blocks.0 1164 | up_blocks.0.attentions.2.transformer_blocks.0.norm1 1165 | up_blocks.0.attentions.2.transformer_blocks.0.attn1 1166 | up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_q 1167 | up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_k 1168 | up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_v 1169 | up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_out 1170 | up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_out.0 1171 | up_blocks.0.attentions.2.transformer_blocks.0.attn1.to_out.1 1172 | up_blocks.0.attentions.2.transformer_blocks.0.norm2 1173 | up_blocks.0.attentions.2.transformer_blocks.0.attn2 1174 | up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_q 1175 | up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_k 1176 | up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_v 1177 | up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_out 1178 | up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_out.0 1179 | up_blocks.0.attentions.2.transformer_blocks.0.attn2.to_out.1 1180 | up_blocks.0.attentions.2.transformer_blocks.0.norm3 1181 | up_blocks.0.attentions.2.transformer_blocks.0.ff 1182 | up_blocks.0.attentions.2.transformer_blocks.0.ff.net 1183 | up_blocks.0.attentions.2.transformer_blocks.0.ff.net.0 1184 | up_blocks.0.attentions.2.transformer_blocks.0.ff.net.0.proj 1185 | up_blocks.0.attentions.2.transformer_blocks.0.ff.net.1 1186 | up_blocks.0.attentions.2.transformer_blocks.0.ff.net.2 1187 | up_blocks.0.attentions.2.transformer_blocks.1 1188 | up_blocks.0.attentions.2.transformer_blocks.1.norm1 1189 | up_blocks.0.attentions.2.transformer_blocks.1.attn1 1190 | up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_q 1191 | up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_k 1192 | up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_v 1193 | up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_out 1194 | up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_out.0 1195 | up_blocks.0.attentions.2.transformer_blocks.1.attn1.to_out.1 1196 | up_blocks.0.attentions.2.transformer_blocks.1.norm2 1197 | up_blocks.0.attentions.2.transformer_blocks.1.attn2 1198 | up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_q 1199 | up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_k 1200 | up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_v 1201 | up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_out 1202 | up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_out.0 1203 | up_blocks.0.attentions.2.transformer_blocks.1.attn2.to_out.1 1204 | up_blocks.0.attentions.2.transformer_blocks.1.norm3 1205 | up_blocks.0.attentions.2.transformer_blocks.1.ff 1206 | up_blocks.0.attentions.2.transformer_blocks.1.ff.net 1207 | up_blocks.0.attentions.2.transformer_blocks.1.ff.net.0 1208 | up_blocks.0.attentions.2.transformer_blocks.1.ff.net.0.proj 1209 | up_blocks.0.attentions.2.transformer_blocks.1.ff.net.1 1210 | up_blocks.0.attentions.2.transformer_blocks.1.ff.net.2 1211 | up_blocks.0.attentions.2.transformer_blocks.2 1212 | up_blocks.0.attentions.2.transformer_blocks.2.norm1 1213 | up_blocks.0.attentions.2.transformer_blocks.2.attn1 1214 | up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_q 1215 | up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_k 1216 | up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_v 1217 | up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_out 1218 | up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_out.0 1219 | up_blocks.0.attentions.2.transformer_blocks.2.attn1.to_out.1 1220 | up_blocks.0.attentions.2.transformer_blocks.2.norm2 1221 | up_blocks.0.attentions.2.transformer_blocks.2.attn2 1222 | up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_q 1223 | up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_k 1224 | up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_v 1225 | up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_out 1226 | up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_out.0 1227 | up_blocks.0.attentions.2.transformer_blocks.2.attn2.to_out.1 1228 | up_blocks.0.attentions.2.transformer_blocks.2.norm3 1229 | up_blocks.0.attentions.2.transformer_blocks.2.ff 1230 | up_blocks.0.attentions.2.transformer_blocks.2.ff.net 1231 | up_blocks.0.attentions.2.transformer_blocks.2.ff.net.0 1232 | up_blocks.0.attentions.2.transformer_blocks.2.ff.net.0.proj 1233 | up_blocks.0.attentions.2.transformer_blocks.2.ff.net.1 1234 | up_blocks.0.attentions.2.transformer_blocks.2.ff.net.2 1235 | up_blocks.0.attentions.2.transformer_blocks.3 1236 | up_blocks.0.attentions.2.transformer_blocks.3.norm1 1237 | up_blocks.0.attentions.2.transformer_blocks.3.attn1 1238 | up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_q 1239 | up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_k 1240 | up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_v 1241 | up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_out 1242 | up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_out.0 1243 | up_blocks.0.attentions.2.transformer_blocks.3.attn1.to_out.1 1244 | up_blocks.0.attentions.2.transformer_blocks.3.norm2 1245 | up_blocks.0.attentions.2.transformer_blocks.3.attn2 1246 | up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_q 1247 | up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_k 1248 | up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_v 1249 | up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_out 1250 | up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_out.0 1251 | up_blocks.0.attentions.2.transformer_blocks.3.attn2.to_out.1 1252 | up_blocks.0.attentions.2.transformer_blocks.3.norm3 1253 | up_blocks.0.attentions.2.transformer_blocks.3.ff 1254 | up_blocks.0.attentions.2.transformer_blocks.3.ff.net 1255 | up_blocks.0.attentions.2.transformer_blocks.3.ff.net.0 1256 | up_blocks.0.attentions.2.transformer_blocks.3.ff.net.0.proj 1257 | up_blocks.0.attentions.2.transformer_blocks.3.ff.net.1 1258 | up_blocks.0.attentions.2.transformer_blocks.3.ff.net.2 1259 | up_blocks.0.attentions.2.transformer_blocks.4 1260 | up_blocks.0.attentions.2.transformer_blocks.4.norm1 1261 | up_blocks.0.attentions.2.transformer_blocks.4.attn1 1262 | up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_q 1263 | up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_k 1264 | up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_v 1265 | up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_out 1266 | up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_out.0 1267 | up_blocks.0.attentions.2.transformer_blocks.4.attn1.to_out.1 1268 | up_blocks.0.attentions.2.transformer_blocks.4.norm2 1269 | up_blocks.0.attentions.2.transformer_blocks.4.attn2 1270 | up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_q 1271 | up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_k 1272 | up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_v 1273 | up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_out 1274 | up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_out.0 1275 | up_blocks.0.attentions.2.transformer_blocks.4.attn2.to_out.1 1276 | up_blocks.0.attentions.2.transformer_blocks.4.norm3 1277 | up_blocks.0.attentions.2.transformer_blocks.4.ff 1278 | up_blocks.0.attentions.2.transformer_blocks.4.ff.net 1279 | up_blocks.0.attentions.2.transformer_blocks.4.ff.net.0 1280 | up_blocks.0.attentions.2.transformer_blocks.4.ff.net.0.proj 1281 | up_blocks.0.attentions.2.transformer_blocks.4.ff.net.1 1282 | up_blocks.0.attentions.2.transformer_blocks.4.ff.net.2 1283 | up_blocks.0.attentions.2.transformer_blocks.5 1284 | up_blocks.0.attentions.2.transformer_blocks.5.norm1 1285 | up_blocks.0.attentions.2.transformer_blocks.5.attn1 1286 | up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_q 1287 | up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_k 1288 | up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_v 1289 | up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_out 1290 | up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_out.0 1291 | up_blocks.0.attentions.2.transformer_blocks.5.attn1.to_out.1 1292 | up_blocks.0.attentions.2.transformer_blocks.5.norm2 1293 | up_blocks.0.attentions.2.transformer_blocks.5.attn2 1294 | up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_q 1295 | up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_k 1296 | up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_v 1297 | up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_out 1298 | up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_out.0 1299 | up_blocks.0.attentions.2.transformer_blocks.5.attn2.to_out.1 1300 | up_blocks.0.attentions.2.transformer_blocks.5.norm3 1301 | up_blocks.0.attentions.2.transformer_blocks.5.ff 1302 | up_blocks.0.attentions.2.transformer_blocks.5.ff.net 1303 | up_blocks.0.attentions.2.transformer_blocks.5.ff.net.0 1304 | up_blocks.0.attentions.2.transformer_blocks.5.ff.net.0.proj 1305 | up_blocks.0.attentions.2.transformer_blocks.5.ff.net.1 1306 | up_blocks.0.attentions.2.transformer_blocks.5.ff.net.2 1307 | up_blocks.0.attentions.2.transformer_blocks.6 1308 | up_blocks.0.attentions.2.transformer_blocks.6.norm1 1309 | up_blocks.0.attentions.2.transformer_blocks.6.attn1 1310 | up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_q 1311 | up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_k 1312 | up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_v 1313 | up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_out 1314 | up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_out.0 1315 | up_blocks.0.attentions.2.transformer_blocks.6.attn1.to_out.1 1316 | up_blocks.0.attentions.2.transformer_blocks.6.norm2 1317 | up_blocks.0.attentions.2.transformer_blocks.6.attn2 1318 | up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_q 1319 | up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_k 1320 | up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_v 1321 | up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_out 1322 | up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_out.0 1323 | up_blocks.0.attentions.2.transformer_blocks.6.attn2.to_out.1 1324 | up_blocks.0.attentions.2.transformer_blocks.6.norm3 1325 | up_blocks.0.attentions.2.transformer_blocks.6.ff 1326 | up_blocks.0.attentions.2.transformer_blocks.6.ff.net 1327 | up_blocks.0.attentions.2.transformer_blocks.6.ff.net.0 1328 | up_blocks.0.attentions.2.transformer_blocks.6.ff.net.0.proj 1329 | up_blocks.0.attentions.2.transformer_blocks.6.ff.net.1 1330 | up_blocks.0.attentions.2.transformer_blocks.6.ff.net.2 1331 | up_blocks.0.attentions.2.transformer_blocks.7 1332 | up_blocks.0.attentions.2.transformer_blocks.7.norm1 1333 | up_blocks.0.attentions.2.transformer_blocks.7.attn1 1334 | up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_q 1335 | up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_k 1336 | up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_v 1337 | up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_out 1338 | up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_out.0 1339 | up_blocks.0.attentions.2.transformer_blocks.7.attn1.to_out.1 1340 | up_blocks.0.attentions.2.transformer_blocks.7.norm2 1341 | up_blocks.0.attentions.2.transformer_blocks.7.attn2 1342 | up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_q 1343 | up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_k 1344 | up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_v 1345 | up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_out 1346 | up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_out.0 1347 | up_blocks.0.attentions.2.transformer_blocks.7.attn2.to_out.1 1348 | up_blocks.0.attentions.2.transformer_blocks.7.norm3 1349 | up_blocks.0.attentions.2.transformer_blocks.7.ff 1350 | up_blocks.0.attentions.2.transformer_blocks.7.ff.net 1351 | up_blocks.0.attentions.2.transformer_blocks.7.ff.net.0 1352 | up_blocks.0.attentions.2.transformer_blocks.7.ff.net.0.proj 1353 | up_blocks.0.attentions.2.transformer_blocks.7.ff.net.1 1354 | up_blocks.0.attentions.2.transformer_blocks.7.ff.net.2 1355 | up_blocks.0.attentions.2.transformer_blocks.8 1356 | up_blocks.0.attentions.2.transformer_blocks.8.norm1 1357 | up_blocks.0.attentions.2.transformer_blocks.8.attn1 1358 | up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_q 1359 | up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_k 1360 | up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_v 1361 | up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_out 1362 | up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_out.0 1363 | up_blocks.0.attentions.2.transformer_blocks.8.attn1.to_out.1 1364 | up_blocks.0.attentions.2.transformer_blocks.8.norm2 1365 | up_blocks.0.attentions.2.transformer_blocks.8.attn2 1366 | up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_q 1367 | up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_k 1368 | up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_v 1369 | up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_out 1370 | up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_out.0 1371 | up_blocks.0.attentions.2.transformer_blocks.8.attn2.to_out.1 1372 | up_blocks.0.attentions.2.transformer_blocks.8.norm3 1373 | up_blocks.0.attentions.2.transformer_blocks.8.ff 1374 | up_blocks.0.attentions.2.transformer_blocks.8.ff.net 1375 | up_blocks.0.attentions.2.transformer_blocks.8.ff.net.0 1376 | up_blocks.0.attentions.2.transformer_blocks.8.ff.net.0.proj 1377 | up_blocks.0.attentions.2.transformer_blocks.8.ff.net.1 1378 | up_blocks.0.attentions.2.transformer_blocks.8.ff.net.2 1379 | up_blocks.0.attentions.2.transformer_blocks.9 1380 | up_blocks.0.attentions.2.transformer_blocks.9.norm1 1381 | up_blocks.0.attentions.2.transformer_blocks.9.attn1 1382 | up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_q 1383 | up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_k 1384 | up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_v 1385 | up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_out 1386 | up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_out.0 1387 | up_blocks.0.attentions.2.transformer_blocks.9.attn1.to_out.1 1388 | up_blocks.0.attentions.2.transformer_blocks.9.norm2 1389 | up_blocks.0.attentions.2.transformer_blocks.9.attn2 1390 | up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_q 1391 | up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_k 1392 | up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_v 1393 | up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_out 1394 | up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_out.0 1395 | up_blocks.0.attentions.2.transformer_blocks.9.attn2.to_out.1 1396 | up_blocks.0.attentions.2.transformer_blocks.9.norm3 1397 | up_blocks.0.attentions.2.transformer_blocks.9.ff 1398 | up_blocks.0.attentions.2.transformer_blocks.9.ff.net 1399 | up_blocks.0.attentions.2.transformer_blocks.9.ff.net.0 1400 | up_blocks.0.attentions.2.transformer_blocks.9.ff.net.0.proj 1401 | up_blocks.0.attentions.2.transformer_blocks.9.ff.net.1 1402 | up_blocks.0.attentions.2.transformer_blocks.9.ff.net.2 1403 | up_blocks.0.attentions.2.proj_out 1404 | up_blocks.0.resnets 1405 | up_blocks.0.resnets.0 1406 | up_blocks.0.resnets.0.norm1 1407 | up_blocks.0.resnets.0.conv1 1408 | up_blocks.0.resnets.0.time_emb_proj 1409 | up_blocks.0.resnets.0.norm2 1410 | up_blocks.0.resnets.0.dropout 1411 | up_blocks.0.resnets.0.conv2 1412 | up_blocks.0.resnets.0.conv_shortcut 1413 | up_blocks.0.resnets.1 1414 | up_blocks.0.resnets.1.norm1 1415 | up_blocks.0.resnets.1.conv1 1416 | up_blocks.0.resnets.1.time_emb_proj 1417 | up_blocks.0.resnets.1.norm2 1418 | up_blocks.0.resnets.1.dropout 1419 | up_blocks.0.resnets.1.conv2 1420 | up_blocks.0.resnets.1.conv_shortcut 1421 | up_blocks.0.resnets.2 1422 | up_blocks.0.resnets.2.norm1 1423 | up_blocks.0.resnets.2.conv1 1424 | up_blocks.0.resnets.2.time_emb_proj 1425 | up_blocks.0.resnets.2.norm2 1426 | up_blocks.0.resnets.2.dropout 1427 | up_blocks.0.resnets.2.conv2 1428 | up_blocks.0.resnets.2.conv_shortcut 1429 | up_blocks.0.upsamplers 1430 | up_blocks.0.upsamplers.0 1431 | up_blocks.0.upsamplers.0.conv 1432 | up_blocks.1 1433 | up_blocks.1.attentions 1434 | up_blocks.1.attentions.0 1435 | up_blocks.1.attentions.0.norm 1436 | up_blocks.1.attentions.0.proj_in 1437 | up_blocks.1.attentions.0.transformer_blocks 1438 | up_blocks.1.attentions.0.transformer_blocks.0 1439 | up_blocks.1.attentions.0.transformer_blocks.0.norm1 1440 | up_blocks.1.attentions.0.transformer_blocks.0.attn1 1441 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_q 1442 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_k 1443 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_v 1444 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out 1445 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.0 1446 | up_blocks.1.attentions.0.transformer_blocks.0.attn1.to_out.1 1447 | up_blocks.1.attentions.0.transformer_blocks.0.norm2 1448 | up_blocks.1.attentions.0.transformer_blocks.0.attn2 1449 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_q 1450 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_k 1451 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_v 1452 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out 1453 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out.0 1454 | up_blocks.1.attentions.0.transformer_blocks.0.attn2.to_out.1 1455 | up_blocks.1.attentions.0.transformer_blocks.0.norm3 1456 | up_blocks.1.attentions.0.transformer_blocks.0.ff 1457 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net 1458 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net.0 1459 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net.0.proj 1460 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net.1 1461 | up_blocks.1.attentions.0.transformer_blocks.0.ff.net.2 1462 | up_blocks.1.attentions.0.transformer_blocks.1 1463 | up_blocks.1.attentions.0.transformer_blocks.1.norm1 1464 | up_blocks.1.attentions.0.transformer_blocks.1.attn1 1465 | up_blocks.1.attentions.0.transformer_blocks.1.attn1.to_q 1466 | up_blocks.1.attentions.0.transformer_blocks.1.attn1.to_k 1467 | up_blocks.1.attentions.0.transformer_blocks.1.attn1.to_v 1468 | up_blocks.1.attentions.0.transformer_blocks.1.attn1.to_out 1469 | up_blocks.1.attentions.0.transformer_blocks.1.attn1.to_out.0 1470 | up_blocks.1.attentions.0.transformer_blocks.1.attn1.to_out.1 1471 | up_blocks.1.attentions.0.transformer_blocks.1.norm2 1472 | up_blocks.1.attentions.0.transformer_blocks.1.attn2 1473 | up_blocks.1.attentions.0.transformer_blocks.1.attn2.to_q 1474 | up_blocks.1.attentions.0.transformer_blocks.1.attn2.to_k 1475 | up_blocks.1.attentions.0.transformer_blocks.1.attn2.to_v 1476 | up_blocks.1.attentions.0.transformer_blocks.1.attn2.to_out 1477 | up_blocks.1.attentions.0.transformer_blocks.1.attn2.to_out.0 1478 | up_blocks.1.attentions.0.transformer_blocks.1.attn2.to_out.1 1479 | up_blocks.1.attentions.0.transformer_blocks.1.norm3 1480 | up_blocks.1.attentions.0.transformer_blocks.1.ff 1481 | up_blocks.1.attentions.0.transformer_blocks.1.ff.net 1482 | up_blocks.1.attentions.0.transformer_blocks.1.ff.net.0 1483 | up_blocks.1.attentions.0.transformer_blocks.1.ff.net.0.proj 1484 | up_blocks.1.attentions.0.transformer_blocks.1.ff.net.1 1485 | up_blocks.1.attentions.0.transformer_blocks.1.ff.net.2 1486 | up_blocks.1.attentions.0.proj_out 1487 | up_blocks.1.attentions.1 1488 | up_blocks.1.attentions.1.norm 1489 | up_blocks.1.attentions.1.proj_in 1490 | up_blocks.1.attentions.1.transformer_blocks 1491 | up_blocks.1.attentions.1.transformer_blocks.0 1492 | up_blocks.1.attentions.1.transformer_blocks.0.norm1 1493 | up_blocks.1.attentions.1.transformer_blocks.0.attn1 1494 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_q 1495 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_k 1496 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_v 1497 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out 1498 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out.0 1499 | up_blocks.1.attentions.1.transformer_blocks.0.attn1.to_out.1 1500 | up_blocks.1.attentions.1.transformer_blocks.0.norm2 1501 | up_blocks.1.attentions.1.transformer_blocks.0.attn2 1502 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_q 1503 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_k 1504 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_v 1505 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out 1506 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out.0 1507 | up_blocks.1.attentions.1.transformer_blocks.0.attn2.to_out.1 1508 | up_blocks.1.attentions.1.transformer_blocks.0.norm3 1509 | up_blocks.1.attentions.1.transformer_blocks.0.ff 1510 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net 1511 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net.0 1512 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net.0.proj 1513 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net.1 1514 | up_blocks.1.attentions.1.transformer_blocks.0.ff.net.2 1515 | up_blocks.1.attentions.1.transformer_blocks.1 1516 | up_blocks.1.attentions.1.transformer_blocks.1.norm1 1517 | up_blocks.1.attentions.1.transformer_blocks.1.attn1 1518 | up_blocks.1.attentions.1.transformer_blocks.1.attn1.to_q 1519 | up_blocks.1.attentions.1.transformer_blocks.1.attn1.to_k 1520 | up_blocks.1.attentions.1.transformer_blocks.1.attn1.to_v 1521 | up_blocks.1.attentions.1.transformer_blocks.1.attn1.to_out 1522 | up_blocks.1.attentions.1.transformer_blocks.1.attn1.to_out.0 1523 | up_blocks.1.attentions.1.transformer_blocks.1.attn1.to_out.1 1524 | up_blocks.1.attentions.1.transformer_blocks.1.norm2 1525 | up_blocks.1.attentions.1.transformer_blocks.1.attn2 1526 | up_blocks.1.attentions.1.transformer_blocks.1.attn2.to_q 1527 | up_blocks.1.attentions.1.transformer_blocks.1.attn2.to_k 1528 | up_blocks.1.attentions.1.transformer_blocks.1.attn2.to_v 1529 | up_blocks.1.attentions.1.transformer_blocks.1.attn2.to_out 1530 | up_blocks.1.attentions.1.transformer_blocks.1.attn2.to_out.0 1531 | up_blocks.1.attentions.1.transformer_blocks.1.attn2.to_out.1 1532 | up_blocks.1.attentions.1.transformer_blocks.1.norm3 1533 | up_blocks.1.attentions.1.transformer_blocks.1.ff 1534 | up_blocks.1.attentions.1.transformer_blocks.1.ff.net 1535 | up_blocks.1.attentions.1.transformer_blocks.1.ff.net.0 1536 | up_blocks.1.attentions.1.transformer_blocks.1.ff.net.0.proj 1537 | up_blocks.1.attentions.1.transformer_blocks.1.ff.net.1 1538 | up_blocks.1.attentions.1.transformer_blocks.1.ff.net.2 1539 | up_blocks.1.attentions.1.proj_out 1540 | up_blocks.1.attentions.2 1541 | up_blocks.1.attentions.2.norm 1542 | up_blocks.1.attentions.2.proj_in 1543 | up_blocks.1.attentions.2.transformer_blocks 1544 | up_blocks.1.attentions.2.transformer_blocks.0 1545 | up_blocks.1.attentions.2.transformer_blocks.0.norm1 1546 | up_blocks.1.attentions.2.transformer_blocks.0.attn1 1547 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_q 1548 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_k 1549 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_v 1550 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_out 1551 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_out.0 1552 | up_blocks.1.attentions.2.transformer_blocks.0.attn1.to_out.1 1553 | up_blocks.1.attentions.2.transformer_blocks.0.norm2 1554 | up_blocks.1.attentions.2.transformer_blocks.0.attn2 1555 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_q 1556 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_k 1557 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_v 1558 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_out 1559 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_out.0 1560 | up_blocks.1.attentions.2.transformer_blocks.0.attn2.to_out.1 1561 | up_blocks.1.attentions.2.transformer_blocks.0.norm3 1562 | up_blocks.1.attentions.2.transformer_blocks.0.ff 1563 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net 1564 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net.0 1565 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net.0.proj 1566 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net.1 1567 | up_blocks.1.attentions.2.transformer_blocks.0.ff.net.2 1568 | up_blocks.1.attentions.2.transformer_blocks.1 1569 | up_blocks.1.attentions.2.transformer_blocks.1.norm1 1570 | up_blocks.1.attentions.2.transformer_blocks.1.attn1 1571 | up_blocks.1.attentions.2.transformer_blocks.1.attn1.to_q 1572 | up_blocks.1.attentions.2.transformer_blocks.1.attn1.to_k 1573 | up_blocks.1.attentions.2.transformer_blocks.1.attn1.to_v 1574 | up_blocks.1.attentions.2.transformer_blocks.1.attn1.to_out 1575 | up_blocks.1.attentions.2.transformer_blocks.1.attn1.to_out.0 1576 | up_blocks.1.attentions.2.transformer_blocks.1.attn1.to_out.1 1577 | up_blocks.1.attentions.2.transformer_blocks.1.norm2 1578 | up_blocks.1.attentions.2.transformer_blocks.1.attn2 1579 | up_blocks.1.attentions.2.transformer_blocks.1.attn2.to_q 1580 | up_blocks.1.attentions.2.transformer_blocks.1.attn2.to_k 1581 | up_blocks.1.attentions.2.transformer_blocks.1.attn2.to_v 1582 | up_blocks.1.attentions.2.transformer_blocks.1.attn2.to_out 1583 | up_blocks.1.attentions.2.transformer_blocks.1.attn2.to_out.0 1584 | up_blocks.1.attentions.2.transformer_blocks.1.attn2.to_out.1 1585 | up_blocks.1.attentions.2.transformer_blocks.1.norm3 1586 | up_blocks.1.attentions.2.transformer_blocks.1.ff 1587 | up_blocks.1.attentions.2.transformer_blocks.1.ff.net 1588 | up_blocks.1.attentions.2.transformer_blocks.1.ff.net.0 1589 | up_blocks.1.attentions.2.transformer_blocks.1.ff.net.0.proj 1590 | up_blocks.1.attentions.2.transformer_blocks.1.ff.net.1 1591 | up_blocks.1.attentions.2.transformer_blocks.1.ff.net.2 1592 | up_blocks.1.attentions.2.proj_out 1593 | up_blocks.1.resnets 1594 | up_blocks.1.resnets.0 1595 | up_blocks.1.resnets.0.norm1 1596 | up_blocks.1.resnets.0.conv1 1597 | up_blocks.1.resnets.0.time_emb_proj 1598 | up_blocks.1.resnets.0.norm2 1599 | up_blocks.1.resnets.0.dropout 1600 | up_blocks.1.resnets.0.conv2 1601 | up_blocks.1.resnets.0.conv_shortcut 1602 | up_blocks.1.resnets.1 1603 | up_blocks.1.resnets.1.norm1 1604 | up_blocks.1.resnets.1.conv1 1605 | up_blocks.1.resnets.1.time_emb_proj 1606 | up_blocks.1.resnets.1.norm2 1607 | up_blocks.1.resnets.1.dropout 1608 | up_blocks.1.resnets.1.conv2 1609 | up_blocks.1.resnets.1.conv_shortcut 1610 | up_blocks.1.resnets.2 1611 | up_blocks.1.resnets.2.norm1 1612 | up_blocks.1.resnets.2.conv1 1613 | up_blocks.1.resnets.2.time_emb_proj 1614 | up_blocks.1.resnets.2.norm2 1615 | up_blocks.1.resnets.2.dropout 1616 | up_blocks.1.resnets.2.conv2 1617 | up_blocks.1.resnets.2.conv_shortcut 1618 | up_blocks.1.upsamplers 1619 | up_blocks.1.upsamplers.0 1620 | up_blocks.1.upsamplers.0.conv 1621 | up_blocks.2 1622 | up_blocks.2.resnets 1623 | up_blocks.2.resnets.0 1624 | up_blocks.2.resnets.0.norm1 1625 | up_blocks.2.resnets.0.conv1 1626 | up_blocks.2.resnets.0.time_emb_proj 1627 | up_blocks.2.resnets.0.norm2 1628 | up_blocks.2.resnets.0.dropout 1629 | up_blocks.2.resnets.0.conv2 1630 | up_blocks.2.resnets.0.conv_shortcut 1631 | up_blocks.2.resnets.1 1632 | up_blocks.2.resnets.1.norm1 1633 | up_blocks.2.resnets.1.conv1 1634 | up_blocks.2.resnets.1.time_emb_proj 1635 | up_blocks.2.resnets.1.norm2 1636 | up_blocks.2.resnets.1.dropout 1637 | up_blocks.2.resnets.1.conv2 1638 | up_blocks.2.resnets.1.conv_shortcut 1639 | up_blocks.2.resnets.2 1640 | up_blocks.2.resnets.2.norm1 1641 | up_blocks.2.resnets.2.conv1 1642 | up_blocks.2.resnets.2.time_emb_proj 1643 | up_blocks.2.resnets.2.norm2 1644 | up_blocks.2.resnets.2.dropout 1645 | up_blocks.2.resnets.2.conv2 1646 | up_blocks.2.resnets.2.conv_shortcut 1647 | mid_block 1648 | mid_block.attentions 1649 | mid_block.attentions.0 1650 | mid_block.attentions.0.norm 1651 | mid_block.attentions.0.proj_in 1652 | mid_block.attentions.0.transformer_blocks 1653 | mid_block.attentions.0.transformer_blocks.0 1654 | mid_block.attentions.0.transformer_blocks.0.norm1 1655 | mid_block.attentions.0.transformer_blocks.0.attn1 1656 | mid_block.attentions.0.transformer_blocks.0.attn1.to_q 1657 | mid_block.attentions.0.transformer_blocks.0.attn1.to_k 1658 | mid_block.attentions.0.transformer_blocks.0.attn1.to_v 1659 | mid_block.attentions.0.transformer_blocks.0.attn1.to_out 1660 | mid_block.attentions.0.transformer_blocks.0.attn1.to_out.0 1661 | mid_block.attentions.0.transformer_blocks.0.attn1.to_out.1 1662 | mid_block.attentions.0.transformer_blocks.0.norm2 1663 | mid_block.attentions.0.transformer_blocks.0.attn2 1664 | mid_block.attentions.0.transformer_blocks.0.attn2.to_q 1665 | mid_block.attentions.0.transformer_blocks.0.attn2.to_k 1666 | mid_block.attentions.0.transformer_blocks.0.attn2.to_v 1667 | mid_block.attentions.0.transformer_blocks.0.attn2.to_out 1668 | mid_block.attentions.0.transformer_blocks.0.attn2.to_out.0 1669 | mid_block.attentions.0.transformer_blocks.0.attn2.to_out.1 1670 | mid_block.attentions.0.transformer_blocks.0.norm3 1671 | mid_block.attentions.0.transformer_blocks.0.ff 1672 | mid_block.attentions.0.transformer_blocks.0.ff.net 1673 | mid_block.attentions.0.transformer_blocks.0.ff.net.0 1674 | mid_block.attentions.0.transformer_blocks.0.ff.net.0.proj 1675 | mid_block.attentions.0.transformer_blocks.0.ff.net.1 1676 | mid_block.attentions.0.transformer_blocks.0.ff.net.2 1677 | mid_block.attentions.0.transformer_blocks.1 1678 | mid_block.attentions.0.transformer_blocks.1.norm1 1679 | mid_block.attentions.0.transformer_blocks.1.attn1 1680 | mid_block.attentions.0.transformer_blocks.1.attn1.to_q 1681 | mid_block.attentions.0.transformer_blocks.1.attn1.to_k 1682 | mid_block.attentions.0.transformer_blocks.1.attn1.to_v 1683 | mid_block.attentions.0.transformer_blocks.1.attn1.to_out 1684 | mid_block.attentions.0.transformer_blocks.1.attn1.to_out.0 1685 | mid_block.attentions.0.transformer_blocks.1.attn1.to_out.1 1686 | mid_block.attentions.0.transformer_blocks.1.norm2 1687 | mid_block.attentions.0.transformer_blocks.1.attn2 1688 | mid_block.attentions.0.transformer_blocks.1.attn2.to_q 1689 | mid_block.attentions.0.transformer_blocks.1.attn2.to_k 1690 | mid_block.attentions.0.transformer_blocks.1.attn2.to_v 1691 | mid_block.attentions.0.transformer_blocks.1.attn2.to_out 1692 | mid_block.attentions.0.transformer_blocks.1.attn2.to_out.0 1693 | mid_block.attentions.0.transformer_blocks.1.attn2.to_out.1 1694 | mid_block.attentions.0.transformer_blocks.1.norm3 1695 | mid_block.attentions.0.transformer_blocks.1.ff 1696 | mid_block.attentions.0.transformer_blocks.1.ff.net 1697 | mid_block.attentions.0.transformer_blocks.1.ff.net.0 1698 | mid_block.attentions.0.transformer_blocks.1.ff.net.0.proj 1699 | mid_block.attentions.0.transformer_blocks.1.ff.net.1 1700 | mid_block.attentions.0.transformer_blocks.1.ff.net.2 1701 | mid_block.attentions.0.transformer_blocks.2 1702 | mid_block.attentions.0.transformer_blocks.2.norm1 1703 | mid_block.attentions.0.transformer_blocks.2.attn1 1704 | mid_block.attentions.0.transformer_blocks.2.attn1.to_q 1705 | mid_block.attentions.0.transformer_blocks.2.attn1.to_k 1706 | mid_block.attentions.0.transformer_blocks.2.attn1.to_v 1707 | mid_block.attentions.0.transformer_blocks.2.attn1.to_out 1708 | mid_block.attentions.0.transformer_blocks.2.attn1.to_out.0 1709 | mid_block.attentions.0.transformer_blocks.2.attn1.to_out.1 1710 | mid_block.attentions.0.transformer_blocks.2.norm2 1711 | mid_block.attentions.0.transformer_blocks.2.attn2 1712 | mid_block.attentions.0.transformer_blocks.2.attn2.to_q 1713 | mid_block.attentions.0.transformer_blocks.2.attn2.to_k 1714 | mid_block.attentions.0.transformer_blocks.2.attn2.to_v 1715 | mid_block.attentions.0.transformer_blocks.2.attn2.to_out 1716 | mid_block.attentions.0.transformer_blocks.2.attn2.to_out.0 1717 | mid_block.attentions.0.transformer_blocks.2.attn2.to_out.1 1718 | mid_block.attentions.0.transformer_blocks.2.norm3 1719 | mid_block.attentions.0.transformer_blocks.2.ff 1720 | mid_block.attentions.0.transformer_blocks.2.ff.net 1721 | mid_block.attentions.0.transformer_blocks.2.ff.net.0 1722 | mid_block.attentions.0.transformer_blocks.2.ff.net.0.proj 1723 | mid_block.attentions.0.transformer_blocks.2.ff.net.1 1724 | mid_block.attentions.0.transformer_blocks.2.ff.net.2 1725 | mid_block.attentions.0.transformer_blocks.3 1726 | mid_block.attentions.0.transformer_blocks.3.norm1 1727 | mid_block.attentions.0.transformer_blocks.3.attn1 1728 | mid_block.attentions.0.transformer_blocks.3.attn1.to_q 1729 | mid_block.attentions.0.transformer_blocks.3.attn1.to_k 1730 | mid_block.attentions.0.transformer_blocks.3.attn1.to_v 1731 | mid_block.attentions.0.transformer_blocks.3.attn1.to_out 1732 | mid_block.attentions.0.transformer_blocks.3.attn1.to_out.0 1733 | mid_block.attentions.0.transformer_blocks.3.attn1.to_out.1 1734 | mid_block.attentions.0.transformer_blocks.3.norm2 1735 | mid_block.attentions.0.transformer_blocks.3.attn2 1736 | mid_block.attentions.0.transformer_blocks.3.attn2.to_q 1737 | mid_block.attentions.0.transformer_blocks.3.attn2.to_k 1738 | mid_block.attentions.0.transformer_blocks.3.attn2.to_v 1739 | mid_block.attentions.0.transformer_blocks.3.attn2.to_out 1740 | mid_block.attentions.0.transformer_blocks.3.attn2.to_out.0 1741 | mid_block.attentions.0.transformer_blocks.3.attn2.to_out.1 1742 | mid_block.attentions.0.transformer_blocks.3.norm3 1743 | mid_block.attentions.0.transformer_blocks.3.ff 1744 | mid_block.attentions.0.transformer_blocks.3.ff.net 1745 | mid_block.attentions.0.transformer_blocks.3.ff.net.0 1746 | mid_block.attentions.0.transformer_blocks.3.ff.net.0.proj 1747 | mid_block.attentions.0.transformer_blocks.3.ff.net.1 1748 | mid_block.attentions.0.transformer_blocks.3.ff.net.2 1749 | mid_block.attentions.0.transformer_blocks.4 1750 | mid_block.attentions.0.transformer_blocks.4.norm1 1751 | mid_block.attentions.0.transformer_blocks.4.attn1 1752 | mid_block.attentions.0.transformer_blocks.4.attn1.to_q 1753 | mid_block.attentions.0.transformer_blocks.4.attn1.to_k 1754 | mid_block.attentions.0.transformer_blocks.4.attn1.to_v 1755 | mid_block.attentions.0.transformer_blocks.4.attn1.to_out 1756 | mid_block.attentions.0.transformer_blocks.4.attn1.to_out.0 1757 | mid_block.attentions.0.transformer_blocks.4.attn1.to_out.1 1758 | mid_block.attentions.0.transformer_blocks.4.norm2 1759 | mid_block.attentions.0.transformer_blocks.4.attn2 1760 | mid_block.attentions.0.transformer_blocks.4.attn2.to_q 1761 | mid_block.attentions.0.transformer_blocks.4.attn2.to_k 1762 | mid_block.attentions.0.transformer_blocks.4.attn2.to_v 1763 | mid_block.attentions.0.transformer_blocks.4.attn2.to_out 1764 | mid_block.attentions.0.transformer_blocks.4.attn2.to_out.0 1765 | mid_block.attentions.0.transformer_blocks.4.attn2.to_out.1 1766 | mid_block.attentions.0.transformer_blocks.4.norm3 1767 | mid_block.attentions.0.transformer_blocks.4.ff 1768 | mid_block.attentions.0.transformer_blocks.4.ff.net 1769 | mid_block.attentions.0.transformer_blocks.4.ff.net.0 1770 | mid_block.attentions.0.transformer_blocks.4.ff.net.0.proj 1771 | mid_block.attentions.0.transformer_blocks.4.ff.net.1 1772 | mid_block.attentions.0.transformer_blocks.4.ff.net.2 1773 | mid_block.attentions.0.transformer_blocks.5 1774 | mid_block.attentions.0.transformer_blocks.5.norm1 1775 | mid_block.attentions.0.transformer_blocks.5.attn1 1776 | mid_block.attentions.0.transformer_blocks.5.attn1.to_q 1777 | mid_block.attentions.0.transformer_blocks.5.attn1.to_k 1778 | mid_block.attentions.0.transformer_blocks.5.attn1.to_v 1779 | mid_block.attentions.0.transformer_blocks.5.attn1.to_out 1780 | mid_block.attentions.0.transformer_blocks.5.attn1.to_out.0 1781 | mid_block.attentions.0.transformer_blocks.5.attn1.to_out.1 1782 | mid_block.attentions.0.transformer_blocks.5.norm2 1783 | mid_block.attentions.0.transformer_blocks.5.attn2 1784 | mid_block.attentions.0.transformer_blocks.5.attn2.to_q 1785 | mid_block.attentions.0.transformer_blocks.5.attn2.to_k 1786 | mid_block.attentions.0.transformer_blocks.5.attn2.to_v 1787 | mid_block.attentions.0.transformer_blocks.5.attn2.to_out 1788 | mid_block.attentions.0.transformer_blocks.5.attn2.to_out.0 1789 | mid_block.attentions.0.transformer_blocks.5.attn2.to_out.1 1790 | mid_block.attentions.0.transformer_blocks.5.norm3 1791 | mid_block.attentions.0.transformer_blocks.5.ff 1792 | mid_block.attentions.0.transformer_blocks.5.ff.net 1793 | mid_block.attentions.0.transformer_blocks.5.ff.net.0 1794 | mid_block.attentions.0.transformer_blocks.5.ff.net.0.proj 1795 | mid_block.attentions.0.transformer_blocks.5.ff.net.1 1796 | mid_block.attentions.0.transformer_blocks.5.ff.net.2 1797 | mid_block.attentions.0.transformer_blocks.6 1798 | mid_block.attentions.0.transformer_blocks.6.norm1 1799 | mid_block.attentions.0.transformer_blocks.6.attn1 1800 | mid_block.attentions.0.transformer_blocks.6.attn1.to_q 1801 | mid_block.attentions.0.transformer_blocks.6.attn1.to_k 1802 | mid_block.attentions.0.transformer_blocks.6.attn1.to_v 1803 | mid_block.attentions.0.transformer_blocks.6.attn1.to_out 1804 | mid_block.attentions.0.transformer_blocks.6.attn1.to_out.0 1805 | mid_block.attentions.0.transformer_blocks.6.attn1.to_out.1 1806 | mid_block.attentions.0.transformer_blocks.6.norm2 1807 | mid_block.attentions.0.transformer_blocks.6.attn2 1808 | mid_block.attentions.0.transformer_blocks.6.attn2.to_q 1809 | mid_block.attentions.0.transformer_blocks.6.attn2.to_k 1810 | mid_block.attentions.0.transformer_blocks.6.attn2.to_v 1811 | mid_block.attentions.0.transformer_blocks.6.attn2.to_out 1812 | mid_block.attentions.0.transformer_blocks.6.attn2.to_out.0 1813 | mid_block.attentions.0.transformer_blocks.6.attn2.to_out.1 1814 | mid_block.attentions.0.transformer_blocks.6.norm3 1815 | mid_block.attentions.0.transformer_blocks.6.ff 1816 | mid_block.attentions.0.transformer_blocks.6.ff.net 1817 | mid_block.attentions.0.transformer_blocks.6.ff.net.0 1818 | mid_block.attentions.0.transformer_blocks.6.ff.net.0.proj 1819 | mid_block.attentions.0.transformer_blocks.6.ff.net.1 1820 | mid_block.attentions.0.transformer_blocks.6.ff.net.2 1821 | mid_block.attentions.0.transformer_blocks.7 1822 | mid_block.attentions.0.transformer_blocks.7.norm1 1823 | mid_block.attentions.0.transformer_blocks.7.attn1 1824 | mid_block.attentions.0.transformer_blocks.7.attn1.to_q 1825 | mid_block.attentions.0.transformer_blocks.7.attn1.to_k 1826 | mid_block.attentions.0.transformer_blocks.7.attn1.to_v 1827 | mid_block.attentions.0.transformer_blocks.7.attn1.to_out 1828 | mid_block.attentions.0.transformer_blocks.7.attn1.to_out.0 1829 | mid_block.attentions.0.transformer_blocks.7.attn1.to_out.1 1830 | mid_block.attentions.0.transformer_blocks.7.norm2 1831 | mid_block.attentions.0.transformer_blocks.7.attn2 1832 | mid_block.attentions.0.transformer_blocks.7.attn2.to_q 1833 | mid_block.attentions.0.transformer_blocks.7.attn2.to_k 1834 | mid_block.attentions.0.transformer_blocks.7.attn2.to_v 1835 | mid_block.attentions.0.transformer_blocks.7.attn2.to_out 1836 | mid_block.attentions.0.transformer_blocks.7.attn2.to_out.0 1837 | mid_block.attentions.0.transformer_blocks.7.attn2.to_out.1 1838 | mid_block.attentions.0.transformer_blocks.7.norm3 1839 | mid_block.attentions.0.transformer_blocks.7.ff 1840 | mid_block.attentions.0.transformer_blocks.7.ff.net 1841 | mid_block.attentions.0.transformer_blocks.7.ff.net.0 1842 | mid_block.attentions.0.transformer_blocks.7.ff.net.0.proj 1843 | mid_block.attentions.0.transformer_blocks.7.ff.net.1 1844 | mid_block.attentions.0.transformer_blocks.7.ff.net.2 1845 | mid_block.attentions.0.transformer_blocks.8 1846 | mid_block.attentions.0.transformer_blocks.8.norm1 1847 | mid_block.attentions.0.transformer_blocks.8.attn1 1848 | mid_block.attentions.0.transformer_blocks.8.attn1.to_q 1849 | mid_block.attentions.0.transformer_blocks.8.attn1.to_k 1850 | mid_block.attentions.0.transformer_blocks.8.attn1.to_v 1851 | mid_block.attentions.0.transformer_blocks.8.attn1.to_out 1852 | mid_block.attentions.0.transformer_blocks.8.attn1.to_out.0 1853 | mid_block.attentions.0.transformer_blocks.8.attn1.to_out.1 1854 | mid_block.attentions.0.transformer_blocks.8.norm2 1855 | mid_block.attentions.0.transformer_blocks.8.attn2 1856 | mid_block.attentions.0.transformer_blocks.8.attn2.to_q 1857 | mid_block.attentions.0.transformer_blocks.8.attn2.to_k 1858 | mid_block.attentions.0.transformer_blocks.8.attn2.to_v 1859 | mid_block.attentions.0.transformer_blocks.8.attn2.to_out 1860 | mid_block.attentions.0.transformer_blocks.8.attn2.to_out.0 1861 | mid_block.attentions.0.transformer_blocks.8.attn2.to_out.1 1862 | mid_block.attentions.0.transformer_blocks.8.norm3 1863 | mid_block.attentions.0.transformer_blocks.8.ff 1864 | mid_block.attentions.0.transformer_blocks.8.ff.net 1865 | mid_block.attentions.0.transformer_blocks.8.ff.net.0 1866 | mid_block.attentions.0.transformer_blocks.8.ff.net.0.proj 1867 | mid_block.attentions.0.transformer_blocks.8.ff.net.1 1868 | mid_block.attentions.0.transformer_blocks.8.ff.net.2 1869 | mid_block.attentions.0.transformer_blocks.9 1870 | mid_block.attentions.0.transformer_blocks.9.norm1 1871 | mid_block.attentions.0.transformer_blocks.9.attn1 1872 | mid_block.attentions.0.transformer_blocks.9.attn1.to_q 1873 | mid_block.attentions.0.transformer_blocks.9.attn1.to_k 1874 | mid_block.attentions.0.transformer_blocks.9.attn1.to_v 1875 | mid_block.attentions.0.transformer_blocks.9.attn1.to_out 1876 | mid_block.attentions.0.transformer_blocks.9.attn1.to_out.0 1877 | mid_block.attentions.0.transformer_blocks.9.attn1.to_out.1 1878 | mid_block.attentions.0.transformer_blocks.9.norm2 1879 | mid_block.attentions.0.transformer_blocks.9.attn2 1880 | mid_block.attentions.0.transformer_blocks.9.attn2.to_q 1881 | mid_block.attentions.0.transformer_blocks.9.attn2.to_k 1882 | mid_block.attentions.0.transformer_blocks.9.attn2.to_v 1883 | mid_block.attentions.0.transformer_blocks.9.attn2.to_out 1884 | mid_block.attentions.0.transformer_blocks.9.attn2.to_out.0 1885 | mid_block.attentions.0.transformer_blocks.9.attn2.to_out.1 1886 | mid_block.attentions.0.transformer_blocks.9.norm3 1887 | mid_block.attentions.0.transformer_blocks.9.ff 1888 | mid_block.attentions.0.transformer_blocks.9.ff.net 1889 | mid_block.attentions.0.transformer_blocks.9.ff.net.0 1890 | mid_block.attentions.0.transformer_blocks.9.ff.net.0.proj 1891 | mid_block.attentions.0.transformer_blocks.9.ff.net.1 1892 | mid_block.attentions.0.transformer_blocks.9.ff.net.2 1893 | mid_block.attentions.0.proj_out 1894 | mid_block.resnets 1895 | mid_block.resnets.0 1896 | mid_block.resnets.0.norm1 1897 | mid_block.resnets.0.conv1 1898 | mid_block.resnets.0.time_emb_proj 1899 | mid_block.resnets.0.norm2 1900 | mid_block.resnets.0.dropout 1901 | mid_block.resnets.0.conv2 1902 | mid_block.resnets.1 1903 | mid_block.resnets.1.norm1 1904 | mid_block.resnets.1.conv1 1905 | mid_block.resnets.1.time_emb_proj 1906 | mid_block.resnets.1.norm2 1907 | mid_block.resnets.1.dropout 1908 | mid_block.resnets.1.conv2 1909 | conv_norm_out 1910 | conv_out 1911 | -------------------------------------------------------------------------------- /hidiffusion/utils.py: -------------------------------------------------------------------------------- 1 | import torch 2 | 3 | 4 | def isinstance_str(x: object, cls_name: str): 5 | """ 6 | Checks whether x has any class *named* cls_name in its ancestry. 7 | Doesn't require access to the class's implementation. 8 | 9 | Useful for patching! 10 | """ 11 | 12 | for _cls in x.__class__.__mro__: 13 | if _cls.__name__ == cls_name: 14 | return True 15 | 16 | return False 17 | 18 | 19 | def init_generator(device: torch.device, fallback: torch.Generator=None): 20 | """ 21 | Forks the current default random generator given device. 22 | """ 23 | if device.type == "cpu": 24 | return torch.Generator(device="cpu").set_state(torch.get_rng_state()) 25 | elif device.type == "cuda": 26 | return torch.Generator(device=device).set_state(torch.cuda.get_rng_state()) 27 | else: 28 | if fallback is None: 29 | return init_generator(torch.device("cpu")) 30 | else: 31 | return fallback 32 | -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | torch>=1.13.1 2 | diffusers>=0.25.0 3 | transformers 4 | accelerate 5 | xformers -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- 1 | from setuptools import find_packages, setup 2 | 3 | setup( 4 | name="hidiffusion", 5 | version="0.1.8", 6 | author="Shen Zhang, Zhaowei Chen, Zhenyu Zhao, Yuhao Chen, Yao Tang, Jiajun Liang", 7 | url="", 8 | description="HiDiffusion: A training-free method to increase the resolution and speed of diffusion models.", 9 | packages=find_packages(), 10 | include_package_data=True, 11 | long_description=open("README.md", "r", encoding="utf-8").read(), 12 | long_description_content_type="text/markdown", 13 | ) --------------------------------------------------------------------------------