├── README.md ├── evaluation_batch.py ├── fig ├── logo.png ├── pipeline.png ├── sample1_chain.gif ├── sample2_chain.gif └── sample3_chain.gif ├── lib ├── datasets.py ├── ddp.py ├── decay_to_init.py ├── dpm_solver_pytorch.py ├── ema.py ├── models.py ├── ops.py ├── rotary.py ├── scalinglaw_utils.py └── utils.py ├── misc ├── bw_tokenizer │ ├── nonbreaking_prefixes │ │ ├── nonbreaking_prefix.de │ │ ├── nonbreaking_prefix.el │ │ └── nonbreaking_prefix.en │ ├── normalize-punctuation.perl │ └── tokenizer.perl ├── gpt2_nll.py ├── owt2_preprocess.py ├── owt2_tokenizer.json ├── owt2_train_tokenizer.py ├── scalinglaw_plots.py └── scalinglaw_sweep.py ├── requirements.txt ├── run_eval.sh ├── run_train.sh └── train.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/README.md -------------------------------------------------------------------------------- /evaluation_batch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/evaluation_batch.py -------------------------------------------------------------------------------- /fig/logo.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/fig/logo.png -------------------------------------------------------------------------------- /fig/pipeline.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/fig/pipeline.png -------------------------------------------------------------------------------- /fig/sample1_chain.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/fig/sample1_chain.gif -------------------------------------------------------------------------------- /fig/sample2_chain.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/fig/sample2_chain.gif -------------------------------------------------------------------------------- /fig/sample3_chain.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/fig/sample3_chain.gif -------------------------------------------------------------------------------- /lib/datasets.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/datasets.py -------------------------------------------------------------------------------- /lib/ddp.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/ddp.py -------------------------------------------------------------------------------- /lib/decay_to_init.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/decay_to_init.py -------------------------------------------------------------------------------- /lib/dpm_solver_pytorch.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/dpm_solver_pytorch.py -------------------------------------------------------------------------------- /lib/ema.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/ema.py -------------------------------------------------------------------------------- /lib/models.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/models.py -------------------------------------------------------------------------------- /lib/ops.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/ops.py -------------------------------------------------------------------------------- /lib/rotary.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/rotary.py -------------------------------------------------------------------------------- /lib/scalinglaw_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/scalinglaw_utils.py -------------------------------------------------------------------------------- /lib/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/lib/utils.py -------------------------------------------------------------------------------- /misc/bw_tokenizer/nonbreaking_prefixes/nonbreaking_prefix.de: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/bw_tokenizer/nonbreaking_prefixes/nonbreaking_prefix.de -------------------------------------------------------------------------------- /misc/bw_tokenizer/nonbreaking_prefixes/nonbreaking_prefix.el: -------------------------------------------------------------------------------- 1 | # for now, just include the Greek equivalent of "Mr." 2 | κ 3 | -------------------------------------------------------------------------------- /misc/bw_tokenizer/nonbreaking_prefixes/nonbreaking_prefix.en: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/bw_tokenizer/nonbreaking_prefixes/nonbreaking_prefix.en -------------------------------------------------------------------------------- /misc/bw_tokenizer/normalize-punctuation.perl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/bw_tokenizer/normalize-punctuation.perl -------------------------------------------------------------------------------- /misc/bw_tokenizer/tokenizer.perl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/bw_tokenizer/tokenizer.perl -------------------------------------------------------------------------------- /misc/gpt2_nll.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/gpt2_nll.py -------------------------------------------------------------------------------- /misc/owt2_preprocess.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/owt2_preprocess.py -------------------------------------------------------------------------------- /misc/owt2_tokenizer.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/owt2_tokenizer.json -------------------------------------------------------------------------------- /misc/owt2_train_tokenizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/owt2_train_tokenizer.py -------------------------------------------------------------------------------- /misc/scalinglaw_plots.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/scalinglaw_plots.py -------------------------------------------------------------------------------- /misc/scalinglaw_sweep.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/misc/scalinglaw_sweep.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/requirements.txt -------------------------------------------------------------------------------- /run_eval.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/run_eval.sh -------------------------------------------------------------------------------- /run_train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/run_train.sh -------------------------------------------------------------------------------- /train.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/HKUNLP/diffusion-of-thoughts/HEAD/train.py --------------------------------------------------------------------------------