├── .gitignore ├── LICENSE ├── README.md ├── big_math_front_page.png ├── reformulation ├── README.md ├── __init__.py ├── big_math_reformulation.png ├── main.py ├── modules.py ├── requirements.txt └── signatures.py └── signals ├── README.md ├── __init__.py ├── add_empty_boxed_signal.py ├── add_hyperlink_signal.py ├── add_language_signal.py ├── add_multipartq_signal.py ├── add_multiple_choice_signal.py ├── add_proof_signal.py ├── add_semdedup_signal.py ├── add_true_false_signal.py ├── add_yes_no_signal.py ├── model_based_signals.py ├── requirements.txt ├── rollouts_based_signals ├── __init__.py ├── evaluate_responses.py ├── example_solve_rate_script.sh ├── math_eval.py ├── sample_from_model.py └── utils │ ├── __init__.py │ ├── openai_server.py │ └── sglang_util.py └── semdedup.py /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/README.md -------------------------------------------------------------------------------- /big_math_front_page.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/big_math_front_page.png -------------------------------------------------------------------------------- /reformulation/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/reformulation/README.md -------------------------------------------------------------------------------- /reformulation/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /reformulation/big_math_reformulation.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/reformulation/big_math_reformulation.png -------------------------------------------------------------------------------- /reformulation/main.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/reformulation/main.py -------------------------------------------------------------------------------- /reformulation/modules.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/reformulation/modules.py -------------------------------------------------------------------------------- /reformulation/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/reformulation/requirements.txt -------------------------------------------------------------------------------- /reformulation/signatures.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/reformulation/signatures.py -------------------------------------------------------------------------------- /signals/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/README.md -------------------------------------------------------------------------------- /signals/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /signals/add_empty_boxed_signal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/add_empty_boxed_signal.py -------------------------------------------------------------------------------- /signals/add_hyperlink_signal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/add_hyperlink_signal.py -------------------------------------------------------------------------------- /signals/add_language_signal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/add_language_signal.py -------------------------------------------------------------------------------- /signals/add_multipartq_signal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/add_multipartq_signal.py -------------------------------------------------------------------------------- /signals/add_multiple_choice_signal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/add_multiple_choice_signal.py -------------------------------------------------------------------------------- /signals/add_proof_signal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/add_proof_signal.py -------------------------------------------------------------------------------- /signals/add_semdedup_signal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/add_semdedup_signal.py -------------------------------------------------------------------------------- /signals/add_true_false_signal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/add_true_false_signal.py -------------------------------------------------------------------------------- /signals/add_yes_no_signal.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/add_yes_no_signal.py -------------------------------------------------------------------------------- /signals/model_based_signals.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/model_based_signals.py -------------------------------------------------------------------------------- /signals/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/requirements.txt -------------------------------------------------------------------------------- /signals/rollouts_based_signals/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /signals/rollouts_based_signals/evaluate_responses.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/rollouts_based_signals/evaluate_responses.py -------------------------------------------------------------------------------- /signals/rollouts_based_signals/example_solve_rate_script.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/rollouts_based_signals/example_solve_rate_script.sh -------------------------------------------------------------------------------- /signals/rollouts_based_signals/math_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/rollouts_based_signals/math_eval.py -------------------------------------------------------------------------------- /signals/rollouts_based_signals/sample_from_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/rollouts_based_signals/sample_from_model.py -------------------------------------------------------------------------------- /signals/rollouts_based_signals/utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /signals/rollouts_based_signals/utils/openai_server.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/rollouts_based_signals/utils/openai_server.py -------------------------------------------------------------------------------- /signals/rollouts_based_signals/utils/sglang_util.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/rollouts_based_signals/utils/sglang_util.py -------------------------------------------------------------------------------- /signals/semdedup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/SynthLabsAI/big-math/HEAD/signals/semdedup.py --------------------------------------------------------------------------------