├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── NOTICE ├── README.md ├── THIRD-PARTY.md ├── environment.yml ├── lm_eval ├── base.py ├── evaluator.py ├── models │ ├── 66b_device_map.txt │ ├── __init__.py │ └── opt.py ├── prefix_matching_copying.py ├── tasks │ ├── arc.py │ ├── glue.py │ ├── hellaswag.py │ ├── lambada.py │ ├── mathqa.py │ ├── openbookqa.py │ ├── piqa.py │ ├── superglue.py │ └── winogrande.py └── utils.py ├── main.py ├── scripts ├── get_fc_ranking.py └── plotting │ ├── combined_pruning.py │ ├── crosstask_accuracy.py │ ├── fc_importance.py │ ├── heatmap.py │ ├── iterative_pruning.py │ ├── prefix_copying_pruning.py │ ├── prefix_copying_task_specific.py │ ├── spearman_rankings.py │ └── style.py └── transformers └── models └── opt └── modeling_opt.py /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/CONTRIBUTING.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/LICENSE -------------------------------------------------------------------------------- /NOTICE: -------------------------------------------------------------------------------- 1 | Copyright Amazon.com, Inc. or its affiliates. All Rights Reserved. 2 | -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/README.md -------------------------------------------------------------------------------- /THIRD-PARTY.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/THIRD-PARTY.md -------------------------------------------------------------------------------- /environment.yml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/environment.yml -------------------------------------------------------------------------------- /lm_eval/base.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/base.py -------------------------------------------------------------------------------- /lm_eval/evaluator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/evaluator.py -------------------------------------------------------------------------------- /lm_eval/models/66b_device_map.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/models/66b_device_map.txt -------------------------------------------------------------------------------- /lm_eval/models/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/models/__init__.py -------------------------------------------------------------------------------- /lm_eval/models/opt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/models/opt.py -------------------------------------------------------------------------------- /lm_eval/prefix_matching_copying.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/prefix_matching_copying.py -------------------------------------------------------------------------------- /lm_eval/tasks/arc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/tasks/arc.py -------------------------------------------------------------------------------- /lm_eval/tasks/glue.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/tasks/glue.py -------------------------------------------------------------------------------- /lm_eval/tasks/hellaswag.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/tasks/hellaswag.py -------------------------------------------------------------------------------- /lm_eval/tasks/lambada.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/tasks/lambada.py -------------------------------------------------------------------------------- /lm_eval/tasks/mathqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/tasks/mathqa.py -------------------------------------------------------------------------------- /lm_eval/tasks/openbookqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/tasks/openbookqa.py -------------------------------------------------------------------------------- /lm_eval/tasks/piqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/tasks/piqa.py -------------------------------------------------------------------------------- /lm_eval/tasks/superglue.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/tasks/superglue.py -------------------------------------------------------------------------------- /lm_eval/tasks/winogrande.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/tasks/winogrande.py -------------------------------------------------------------------------------- /lm_eval/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/lm_eval/utils.py -------------------------------------------------------------------------------- /main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/main.py -------------------------------------------------------------------------------- /scripts/get_fc_ranking.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/get_fc_ranking.py -------------------------------------------------------------------------------- /scripts/plotting/combined_pruning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/plotting/combined_pruning.py -------------------------------------------------------------------------------- /scripts/plotting/crosstask_accuracy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/plotting/crosstask_accuracy.py -------------------------------------------------------------------------------- /scripts/plotting/fc_importance.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/plotting/fc_importance.py -------------------------------------------------------------------------------- /scripts/plotting/heatmap.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/plotting/heatmap.py -------------------------------------------------------------------------------- /scripts/plotting/iterative_pruning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/plotting/iterative_pruning.py -------------------------------------------------------------------------------- /scripts/plotting/prefix_copying_pruning.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/plotting/prefix_copying_pruning.py -------------------------------------------------------------------------------- /scripts/plotting/prefix_copying_task_specific.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/plotting/prefix_copying_task_specific.py -------------------------------------------------------------------------------- /scripts/plotting/spearman_rankings.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/plotting/spearman_rankings.py -------------------------------------------------------------------------------- /scripts/plotting/style.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/scripts/plotting/style.py -------------------------------------------------------------------------------- /transformers/models/opt/modeling_opt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/amazon-science/llm-interpret/HEAD/transformers/models/opt/modeling_opt.py --------------------------------------------------------------------------------