├── .gitignore ├── LICENSE ├── README.md ├── config.py ├── configs ├── dat_base.yaml ├── dat_base_384.yaml ├── dat_p.yaml ├── dat_small.yaml └── dat_tiny.yaml ├── data ├── __init__.py ├── build.py └── samplers.py ├── evaluate.sh ├── figures ├── datt.png ├── motivation.png └── vis.png ├── logger.py ├── lr_scheduler.py ├── main.py ├── map_22kto1k.pth ├── models ├── __init__.py ├── build.py ├── dat.py ├── dat_blocks.py ├── nat.py ├── qna.py └── slide.py ├── optimizer.py ├── slurm_main.py ├── train.sh ├── train_slurm.sh └── utils.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/README.md -------------------------------------------------------------------------------- /config.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/config.py -------------------------------------------------------------------------------- /configs/dat_base.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/configs/dat_base.yaml -------------------------------------------------------------------------------- /configs/dat_base_384.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/configs/dat_base_384.yaml -------------------------------------------------------------------------------- /configs/dat_p.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/configs/dat_p.yaml -------------------------------------------------------------------------------- /configs/dat_small.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/configs/dat_small.yaml -------------------------------------------------------------------------------- /configs/dat_tiny.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/configs/dat_tiny.yaml -------------------------------------------------------------------------------- /data/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/data/__init__.py -------------------------------------------------------------------------------- /data/build.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/data/build.py -------------------------------------------------------------------------------- /data/samplers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/data/samplers.py -------------------------------------------------------------------------------- /evaluate.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/evaluate.sh -------------------------------------------------------------------------------- /figures/datt.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/figures/datt.png -------------------------------------------------------------------------------- /figures/motivation.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/figures/motivation.png -------------------------------------------------------------------------------- /figures/vis.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/figures/vis.png -------------------------------------------------------------------------------- /logger.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/logger.py -------------------------------------------------------------------------------- /lr_scheduler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/lr_scheduler.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/main.py -------------------------------------------------------------------------------- /map_22kto1k.pth: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/map_22kto1k.pth -------------------------------------------------------------------------------- /models/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/models/__init__.py -------------------------------------------------------------------------------- /models/build.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/models/build.py -------------------------------------------------------------------------------- /models/dat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/models/dat.py -------------------------------------------------------------------------------- /models/dat_blocks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/models/dat_blocks.py -------------------------------------------------------------------------------- /models/nat.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/models/nat.py -------------------------------------------------------------------------------- /models/qna.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/models/qna.py -------------------------------------------------------------------------------- /models/slide.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/models/slide.py -------------------------------------------------------------------------------- /optimizer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/optimizer.py -------------------------------------------------------------------------------- /slurm_main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/slurm_main.py -------------------------------------------------------------------------------- /train.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/train.sh -------------------------------------------------------------------------------- /train_slurm.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/train_slurm.sh -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/LeapLabTHU/DAT/HEAD/utils.py --------------------------------------------------------------------------------