├── README.md ├── assets ├── 00053009.gif ├── 00054448.gif ├── 00055575.gif ├── 00056215.gif ├── 00058391.gif ├── 00058464.gif └── pipeline.png ├── class_weights.json ├── data └── data_resized │ └── dataset_split.json ├── data_loader ├── data_loader.py ├── image_loader.py └── sequence_retriver.py ├── eval_qa.py ├── experiment.py ├── generate_dataset.py ├── main.py ├── model ├── autoregressive_transformer.py ├── base_transformer.py ├── model_factory.py └── trajectory_model.py ├── model_configs ├── autoregressive_transformer.json ├── final_experiments.json ├── transformer_experiments.json └── vid_pretrained.json ├── qa_analysis.py ├── requirements.txt ├── test.py ├── trainer.py ├── transform_dataset.py └── utils.py /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/README.md -------------------------------------------------------------------------------- /assets/00053009.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/assets/00053009.gif -------------------------------------------------------------------------------- /assets/00054448.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/assets/00054448.gif -------------------------------------------------------------------------------- /assets/00055575.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/assets/00055575.gif -------------------------------------------------------------------------------- /assets/00056215.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/assets/00056215.gif -------------------------------------------------------------------------------- /assets/00058391.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/assets/00058391.gif -------------------------------------------------------------------------------- /assets/00058464.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/assets/00058464.gif -------------------------------------------------------------------------------- /assets/pipeline.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/assets/pipeline.png -------------------------------------------------------------------------------- /class_weights.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/class_weights.json -------------------------------------------------------------------------------- /data/data_resized/dataset_split.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/data/data_resized/dataset_split.json -------------------------------------------------------------------------------- /data_loader/data_loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/data_loader/data_loader.py -------------------------------------------------------------------------------- /data_loader/image_loader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/data_loader/image_loader.py -------------------------------------------------------------------------------- /data_loader/sequence_retriver.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/data_loader/sequence_retriver.py -------------------------------------------------------------------------------- /eval_qa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/eval_qa.py -------------------------------------------------------------------------------- /experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/experiment.py -------------------------------------------------------------------------------- /generate_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/generate_dataset.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/main.py -------------------------------------------------------------------------------- /model/autoregressive_transformer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/model/autoregressive_transformer.py -------------------------------------------------------------------------------- /model/base_transformer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/model/base_transformer.py -------------------------------------------------------------------------------- /model/model_factory.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/model/model_factory.py -------------------------------------------------------------------------------- /model/trajectory_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/model/trajectory_model.py -------------------------------------------------------------------------------- /model_configs/autoregressive_transformer.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/model_configs/autoregressive_transformer.json -------------------------------------------------------------------------------- /model_configs/final_experiments.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/model_configs/final_experiments.json -------------------------------------------------------------------------------- /model_configs/transformer_experiments.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/model_configs/transformer_experiments.json -------------------------------------------------------------------------------- /model_configs/vid_pretrained.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/model_configs/vid_pretrained.json -------------------------------------------------------------------------------- /qa_analysis.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/qa_analysis.py -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/requirements.txt -------------------------------------------------------------------------------- /test.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/test.py -------------------------------------------------------------------------------- /trainer.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/trainer.py -------------------------------------------------------------------------------- /transform_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/transform_dataset.py -------------------------------------------------------------------------------- /utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/ghadinehme/VideoCAD/HEAD/utils.py --------------------------------------------------------------------------------