├── .gitignore ├── CODE_OF_CONDUCT.md ├── LICENSE ├── README.md ├── SECURITY.md ├── SUPPORT.md ├── collabllm ├── __init__.py ├── datasets │ ├── __init__.py │ ├── multiturn.py │ └── single_turn.py ├── metric.py ├── modules │ ├── __init__.py │ ├── llm_collaborator.py │ └── user_simulator.py ├── prompts │ ├── __init__.py │ ├── extract_multiturn_completion.txt │ ├── proact_instruction.txt │ ├── system_prompt.txt │ └── user_simulator.txt ├── reward.py ├── simulation.py ├── synthetic.py └── utils │ ├── extract_json_reliable.py │ ├── format.py │ └── template.py ├── examples ├── metrics │ ├── __init__.py │ ├── accuracy.py │ ├── bleu.py │ ├── efficiency.py │ ├── interactivity.py │ ├── pass_rate.py │ └── reward_model.py └── single_turn_ds │ ├── __init__.py │ ├── abg_coqa.py │ ├── bigcodebench.py │ ├── math_hard.py │ └── medium.py ├── notebook_tutorials ├── README.md ├── build_datasets.ipynb ├── compute_mr_api.ipynb └── compute_mr_local.ipynb ├── pyproject.toml ├── scripts ├── engine │ ├── build_dataset.py │ └── inference.py └── train │ ├── offline_dpo.py │ ├── online_dpo.py │ ├── ppo.py │ └── sft.py └── transparency_document.pdf /.gitignore: -------------------------------------------------------------------------------- 1 | __pycache__ 2 | outputs 3 | -------------------------------------------------------------------------------- /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/README.md -------------------------------------------------------------------------------- /SECURITY.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/SECURITY.md -------------------------------------------------------------------------------- /SUPPORT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/SUPPORT.md -------------------------------------------------------------------------------- /collabllm/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/__init__.py -------------------------------------------------------------------------------- /collabllm/datasets/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/datasets/__init__.py -------------------------------------------------------------------------------- /collabllm/datasets/multiturn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/datasets/multiturn.py -------------------------------------------------------------------------------- /collabllm/datasets/single_turn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/datasets/single_turn.py -------------------------------------------------------------------------------- /collabllm/metric.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/metric.py -------------------------------------------------------------------------------- /collabllm/modules/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/modules/__init__.py -------------------------------------------------------------------------------- /collabllm/modules/llm_collaborator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/modules/llm_collaborator.py -------------------------------------------------------------------------------- /collabllm/modules/user_simulator.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/modules/user_simulator.py -------------------------------------------------------------------------------- /collabllm/prompts/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/prompts/__init__.py -------------------------------------------------------------------------------- /collabllm/prompts/extract_multiturn_completion.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/prompts/extract_multiturn_completion.txt -------------------------------------------------------------------------------- /collabllm/prompts/proact_instruction.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/prompts/proact_instruction.txt -------------------------------------------------------------------------------- /collabllm/prompts/system_prompt.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/prompts/system_prompt.txt -------------------------------------------------------------------------------- /collabllm/prompts/user_simulator.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/prompts/user_simulator.txt -------------------------------------------------------------------------------- /collabllm/reward.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/reward.py -------------------------------------------------------------------------------- /collabllm/simulation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/simulation.py -------------------------------------------------------------------------------- /collabllm/synthetic.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/synthetic.py -------------------------------------------------------------------------------- /collabllm/utils/extract_json_reliable.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/utils/extract_json_reliable.py -------------------------------------------------------------------------------- /collabllm/utils/format.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/utils/format.py -------------------------------------------------------------------------------- /collabllm/utils/template.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/collabllm/utils/template.py -------------------------------------------------------------------------------- /examples/metrics/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/metrics/__init__.py -------------------------------------------------------------------------------- /examples/metrics/accuracy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/metrics/accuracy.py -------------------------------------------------------------------------------- /examples/metrics/bleu.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/metrics/bleu.py -------------------------------------------------------------------------------- /examples/metrics/efficiency.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/metrics/efficiency.py -------------------------------------------------------------------------------- /examples/metrics/interactivity.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/metrics/interactivity.py -------------------------------------------------------------------------------- /examples/metrics/pass_rate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/metrics/pass_rate.py -------------------------------------------------------------------------------- /examples/metrics/reward_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/metrics/reward_model.py -------------------------------------------------------------------------------- /examples/single_turn_ds/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/single_turn_ds/__init__.py -------------------------------------------------------------------------------- /examples/single_turn_ds/abg_coqa.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/single_turn_ds/abg_coqa.py -------------------------------------------------------------------------------- /examples/single_turn_ds/bigcodebench.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/single_turn_ds/bigcodebench.py -------------------------------------------------------------------------------- /examples/single_turn_ds/math_hard.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/single_turn_ds/math_hard.py -------------------------------------------------------------------------------- /examples/single_turn_ds/medium.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/examples/single_turn_ds/medium.py -------------------------------------------------------------------------------- /notebook_tutorials/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/notebook_tutorials/README.md -------------------------------------------------------------------------------- /notebook_tutorials/build_datasets.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/notebook_tutorials/build_datasets.ipynb -------------------------------------------------------------------------------- /notebook_tutorials/compute_mr_api.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/notebook_tutorials/compute_mr_api.ipynb -------------------------------------------------------------------------------- /notebook_tutorials/compute_mr_local.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/notebook_tutorials/compute_mr_local.ipynb -------------------------------------------------------------------------------- /pyproject.toml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/pyproject.toml -------------------------------------------------------------------------------- /scripts/engine/build_dataset.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/scripts/engine/build_dataset.py -------------------------------------------------------------------------------- /scripts/engine/inference.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/scripts/engine/inference.py -------------------------------------------------------------------------------- /scripts/train/offline_dpo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/scripts/train/offline_dpo.py -------------------------------------------------------------------------------- /scripts/train/online_dpo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/scripts/train/online_dpo.py -------------------------------------------------------------------------------- /scripts/train/ppo.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/scripts/train/ppo.py -------------------------------------------------------------------------------- /scripts/train/sft.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/scripts/train/sft.py -------------------------------------------------------------------------------- /transparency_document.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/microsoft/CollabLLM/HEAD/transparency_document.pdf --------------------------------------------------------------------------------