├── .gitignore ├── README.md ├── ema └── value_residual.ipynb ├── generate_gpt.py ├── generated_images ├── generated_000_class1.png ├── generated_000_class726.png ├── generated_001_class130.png ├── generated_001_class917.png ├── generated_002_class933.png └── generated_003_class833.png ├── nccl_test.py ├── oneclick_setup.sh ├── sweep.sh ├── tokenize_dataset ├── comparison_grid.png ├── concat.py ├── download.py ├── imagenet_labels.py ├── install.sh ├── make_grid.py ├── reconstructed_images │ ├── reconstructed_0000000_plane, carpenter's plane, woodworking plane_continuous.png │ ├── reconstructed_0000000_plane, carpenter's plane, woodworking plane_discrete.png │ ├── reconstructed_0000001_comic book_discrete.png │ ├── reconstructed_0000002_junco, snowbird_discrete.png │ ├── reconstructed_0000003_zucchini, courgette_discrete.png │ ├── reconstructed_0000004_stingray_discrete.png │ ├── reconstructed_0000005_scuba diver_discrete.png │ ├── reconstructed_0000006_miniskirt, mini_discrete.png │ ├── reconstructed_0000007_grand piano, grand_discrete.png │ ├── reconstructed_0000008_parallel bars, bars_discrete.png │ ├── reconstructed_0000009_syringe_discrete.png │ ├── reconstructed_0100000_cello, violoncello_continuous.png │ ├── reconstructed_0100000_cello, violoncello_discrete.png │ ├── reconstructed_0200000_Newfoundland, Newfoundland dog_continuous.png │ ├── reconstructed_0200000_Newfoundland, Newfoundland dog_discrete.png │ ├── reconstructed_0300000_toy poodle_continuous.png │ ├── reconstructed_0300000_toy poodle_discrete.png │ ├── reconstructed_0400000_pedestal, plinth, footstall_continuous.png │ ├── reconstructed_0400000_pedestal, plinth, footstall_discrete.png │ ├── reconstructed_0500000_puck, hockey puck_continuous.png │ ├── reconstructed_0500000_puck, hockey puck_discrete.png │ ├── reconstructed_0600000_loggerhead, loggerhead turtle, Caretta caretta_continuous.png │ ├── reconstructed_0600000_loggerhead, loggerhead turtle, Caretta caretta_discrete.png │ ├── reconstructed_0700000_Irish terrier_continuous.png │ ├── reconstructed_0700000_Irish terrier_discrete.png │ ├── reconstructed_0800000_pier_continuous.png │ ├── reconstructed_0800000_pier_discrete.png │ ├── reconstructed_0900000_mortar_continuous.png │ └── reconstructed_0900000_mortar_discrete.png ├── tokenize_imagenet_numpy.py ├── upload.py └── visualize.py ├── train_gpt.py └── train_gpt_or_diffusion.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/.gitignore -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/README.md -------------------------------------------------------------------------------- /ema/value_residual.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/ema/value_residual.ipynb -------------------------------------------------------------------------------- /generate_gpt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/generate_gpt.py -------------------------------------------------------------------------------- /generated_images/generated_000_class1.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/generated_images/generated_000_class1.png -------------------------------------------------------------------------------- /generated_images/generated_000_class726.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/generated_images/generated_000_class726.png -------------------------------------------------------------------------------- /generated_images/generated_001_class130.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/generated_images/generated_001_class130.png -------------------------------------------------------------------------------- /generated_images/generated_001_class917.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/generated_images/generated_001_class917.png -------------------------------------------------------------------------------- /generated_images/generated_002_class933.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/generated_images/generated_002_class933.png -------------------------------------------------------------------------------- /generated_images/generated_003_class833.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/generated_images/generated_003_class833.png -------------------------------------------------------------------------------- /nccl_test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/nccl_test.py -------------------------------------------------------------------------------- /oneclick_setup.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/oneclick_setup.sh -------------------------------------------------------------------------------- /sweep.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/sweep.sh -------------------------------------------------------------------------------- /tokenize_dataset/comparison_grid.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/comparison_grid.png -------------------------------------------------------------------------------- /tokenize_dataset/concat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/concat.py -------------------------------------------------------------------------------- /tokenize_dataset/download.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/download.py -------------------------------------------------------------------------------- /tokenize_dataset/imagenet_labels.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/imagenet_labels.py -------------------------------------------------------------------------------- /tokenize_dataset/install.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/install.sh -------------------------------------------------------------------------------- /tokenize_dataset/make_grid.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/make_grid.py -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000000_plane, carpenter's plane, woodworking plane_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000000_plane, carpenter's plane, woodworking plane_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000000_plane, carpenter's plane, woodworking plane_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000000_plane, carpenter's plane, woodworking plane_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000001_comic book_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000001_comic book_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000002_junco, snowbird_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000002_junco, snowbird_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000003_zucchini, courgette_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000003_zucchini, courgette_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000004_stingray_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000004_stingray_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000005_scuba diver_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000005_scuba diver_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000006_miniskirt, mini_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000006_miniskirt, mini_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000007_grand piano, grand_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000007_grand piano, grand_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000008_parallel bars, bars_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000008_parallel bars, bars_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0000009_syringe_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0000009_syringe_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0100000_cello, violoncello_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0100000_cello, violoncello_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0100000_cello, violoncello_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0100000_cello, violoncello_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0200000_Newfoundland, Newfoundland dog_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0200000_Newfoundland, Newfoundland dog_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0200000_Newfoundland, Newfoundland dog_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0200000_Newfoundland, Newfoundland dog_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0300000_toy poodle_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0300000_toy poodle_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0300000_toy poodle_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0300000_toy poodle_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0400000_pedestal, plinth, footstall_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0400000_pedestal, plinth, footstall_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0400000_pedestal, plinth, footstall_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0400000_pedestal, plinth, footstall_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0500000_puck, hockey puck_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0500000_puck, hockey puck_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0500000_puck, hockey puck_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0500000_puck, hockey puck_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0600000_loggerhead, loggerhead turtle, Caretta caretta_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0600000_loggerhead, loggerhead turtle, Caretta caretta_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0600000_loggerhead, loggerhead turtle, Caretta caretta_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0600000_loggerhead, loggerhead turtle, Caretta caretta_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0700000_Irish terrier_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0700000_Irish terrier_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0700000_Irish terrier_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0700000_Irish terrier_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0800000_pier_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0800000_pier_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0800000_pier_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0800000_pier_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0900000_mortar_continuous.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0900000_mortar_continuous.png -------------------------------------------------------------------------------- /tokenize_dataset/reconstructed_images/reconstructed_0900000_mortar_discrete.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/reconstructed_images/reconstructed_0900000_mortar_discrete.png -------------------------------------------------------------------------------- /tokenize_dataset/tokenize_imagenet_numpy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/tokenize_imagenet_numpy.py -------------------------------------------------------------------------------- /tokenize_dataset/upload.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/upload.py -------------------------------------------------------------------------------- /tokenize_dataset/visualize.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/tokenize_dataset/visualize.py -------------------------------------------------------------------------------- /train_gpt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/train_gpt.py -------------------------------------------------------------------------------- /train_gpt_or_diffusion.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/fal-ai/diffusion-speedrun/HEAD/train_gpt_or_diffusion.py --------------------------------------------------------------------------------