├── LICENSE ├── README.md ├── eval_data ├── chess.pkl ├── math.pkl └── mmlu.pkl ├── figs ├── gif.gif ├── setting.jpg └── setting.png ├── requirements.txt └── src ├── api.py ├── conformity_and_consistency.py ├── dataloader.py ├── draw ├── __init__.py ├── draw_10_agent.py ├── draw_10_agent_consistent.py ├── draw_10_agent_consistent_line.py ├── draw_10_turn.py ├── draw_agent.py ├── draw_conformity.py ├── draw_consistent.py ├── draw_distribution.py ├── draw_radar.py ├── draw_strategy.py ├── draw_turn.py ├── draw_word.py └── utils.py ├── evaluate.py ├── prompt.py ├── results └── README.md ├── run_agent.py ├── run_agent.sh ├── run_main.py ├── run_main.sh ├── run_strategy.py ├── run_strategy.sh ├── run_turn.sh └── utils.py /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/README.md -------------------------------------------------------------------------------- /eval_data/chess.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/eval_data/chess.pkl -------------------------------------------------------------------------------- /eval_data/math.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/eval_data/math.pkl -------------------------------------------------------------------------------- /eval_data/mmlu.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/eval_data/mmlu.pkl -------------------------------------------------------------------------------- /figs/gif.gif: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/figs/gif.gif -------------------------------------------------------------------------------- /figs/setting.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/figs/setting.jpg -------------------------------------------------------------------------------- /figs/setting.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/figs/setting.png -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- 1 | openai==0.27.8 2 | tqdm 3 | tiktoken 4 | pandas 5 | numpy 6 | wordcloud 7 | torch 8 | -------------------------------------------------------------------------------- /src/api.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/api.py -------------------------------------------------------------------------------- /src/conformity_and_consistency.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/conformity_and_consistency.py -------------------------------------------------------------------------------- /src/dataloader.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/dataloader.py -------------------------------------------------------------------------------- /src/draw/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/__init__.py -------------------------------------------------------------------------------- /src/draw/draw_10_agent.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_10_agent.py -------------------------------------------------------------------------------- /src/draw/draw_10_agent_consistent.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_10_agent_consistent.py -------------------------------------------------------------------------------- /src/draw/draw_10_agent_consistent_line.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_10_agent_consistent_line.py -------------------------------------------------------------------------------- /src/draw/draw_10_turn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_10_turn.py -------------------------------------------------------------------------------- /src/draw/draw_agent.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_agent.py -------------------------------------------------------------------------------- /src/draw/draw_conformity.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_conformity.py -------------------------------------------------------------------------------- /src/draw/draw_consistent.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_consistent.py -------------------------------------------------------------------------------- /src/draw/draw_distribution.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_distribution.py -------------------------------------------------------------------------------- /src/draw/draw_radar.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_radar.py -------------------------------------------------------------------------------- /src/draw/draw_strategy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_strategy.py -------------------------------------------------------------------------------- /src/draw/draw_turn.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_turn.py -------------------------------------------------------------------------------- /src/draw/draw_word.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/draw_word.py -------------------------------------------------------------------------------- /src/draw/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/draw/utils.py -------------------------------------------------------------------------------- /src/evaluate.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/evaluate.py -------------------------------------------------------------------------------- /src/prompt.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/prompt.py -------------------------------------------------------------------------------- /src/results/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/results/README.md -------------------------------------------------------------------------------- /src/run_agent.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/run_agent.py -------------------------------------------------------------------------------- /src/run_agent.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/run_agent.sh -------------------------------------------------------------------------------- /src/run_main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/run_main.py -------------------------------------------------------------------------------- /src/run_main.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/run_main.sh -------------------------------------------------------------------------------- /src/run_strategy.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/run_strategy.py -------------------------------------------------------------------------------- /src/run_strategy.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/run_strategy.sh -------------------------------------------------------------------------------- /src/run_turn.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/run_turn.sh -------------------------------------------------------------------------------- /src/utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/zjunlp/MachineSoM/HEAD/src/utils.py --------------------------------------------------------------------------------