├── .gitignore ├── README.md ├── compute_fisher_matrix.py ├── data ├── eval │ ├── gen │ │ ├── obj_move_path.json │ │ ├── plan_gen.json │ │ ├── plan_gen_confusing.json │ │ ├── plan_gen_unseen.json │ │ └── plan_gen_unseen_confusing.json │ └── qa │ │ ├── act_infer.json │ │ ├── act_recog.json │ │ ├── count.json │ │ ├── housework_qa.json │ │ ├── neg_housework_qa.json │ │ └── obj_move.json └── train │ ├── train_act_recog.json │ ├── train_count.json │ ├── train_obj_move.json │ └── train_plan_gen.json ├── eval_gen.py ├── eval_ppl.py ├── eval_qa.py ├── method.png ├── requirements.txt ├── run.py ├── scripts ├── accelerate_config.json ├── eval_gen_1.3B.sh ├── eval_gen_6B.sh ├── eval_qa_1.3B.sh ├── eval_qa_6B.sh ├── run_1.3B.sh ├── run_1.3B_multi_gpu.sh ├── run_6B.sh └── run_6B_multi_gpu.sh └── world.png /.gitignore: -------------------------------------------------------------------------------- 1 | .idea/ 2 | */__pycache__/ 3 | *.py[cod] 4 | wandb/ 5 | output*/ 6 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/README.md -------------------------------------------------------------------------------- /compute_fisher_matrix.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/compute_fisher_matrix.py -------------------------------------------------------------------------------- /data/eval/gen/obj_move_path.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/gen/obj_move_path.json -------------------------------------------------------------------------------- /data/eval/gen/plan_gen.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/gen/plan_gen.json -------------------------------------------------------------------------------- /data/eval/gen/plan_gen_confusing.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/gen/plan_gen_confusing.json -------------------------------------------------------------------------------- /data/eval/gen/plan_gen_unseen.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/gen/plan_gen_unseen.json -------------------------------------------------------------------------------- /data/eval/gen/plan_gen_unseen_confusing.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/gen/plan_gen_unseen_confusing.json -------------------------------------------------------------------------------- /data/eval/qa/act_infer.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/qa/act_infer.json -------------------------------------------------------------------------------- /data/eval/qa/act_recog.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/qa/act_recog.json -------------------------------------------------------------------------------- /data/eval/qa/count.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/qa/count.json -------------------------------------------------------------------------------- /data/eval/qa/housework_qa.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/qa/housework_qa.json -------------------------------------------------------------------------------- /data/eval/qa/neg_housework_qa.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/qa/neg_housework_qa.json -------------------------------------------------------------------------------- /data/eval/qa/obj_move.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/eval/qa/obj_move.json -------------------------------------------------------------------------------- /data/train/train_act_recog.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/train/train_act_recog.json -------------------------------------------------------------------------------- /data/train/train_count.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/train/train_count.json -------------------------------------------------------------------------------- /data/train/train_obj_move.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/train/train_obj_move.json -------------------------------------------------------------------------------- /data/train/train_plan_gen.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/data/train/train_plan_gen.json -------------------------------------------------------------------------------- /eval_gen.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/eval_gen.py -------------------------------------------------------------------------------- /eval_ppl.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/eval_ppl.py -------------------------------------------------------------------------------- /eval_qa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/eval_qa.py -------------------------------------------------------------------------------- /method.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/method.png -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/requirements.txt -------------------------------------------------------------------------------- /run.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/run.py -------------------------------------------------------------------------------- /scripts/accelerate_config.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/scripts/accelerate_config.json -------------------------------------------------------------------------------- /scripts/eval_gen_1.3B.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/scripts/eval_gen_1.3B.sh -------------------------------------------------------------------------------- /scripts/eval_gen_6B.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/scripts/eval_gen_6B.sh -------------------------------------------------------------------------------- /scripts/eval_qa_1.3B.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/scripts/eval_qa_1.3B.sh -------------------------------------------------------------------------------- /scripts/eval_qa_6B.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/scripts/eval_qa_6B.sh -------------------------------------------------------------------------------- /scripts/run_1.3B.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/scripts/run_1.3B.sh -------------------------------------------------------------------------------- /scripts/run_1.3B_multi_gpu.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/scripts/run_1.3B_multi_gpu.sh -------------------------------------------------------------------------------- /scripts/run_6B.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/scripts/run_6B.sh -------------------------------------------------------------------------------- /scripts/run_6B_multi_gpu.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/scripts/run_6B_multi_gpu.sh -------------------------------------------------------------------------------- /world.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/szxiangjn/world-model-for-language-model/HEAD/world.png --------------------------------------------------------------------------------