├── .env-example ├── .gitignore ├── LICENSE ├── README.md ├── example_prompts ├── ade_corpus_v2.txt ├── banking_77.txt ├── neurips_impact_statement_risks.txt ├── one_stop_english.txt ├── overruling.txt ├── semiconductor_org_types.txt ├── systematic_review_inclusion.txt ├── tai_safety_research.txt ├── terms_of_service.txt ├── tweet_eval_hate.txt └── twitter_complaints.txt ├── requirements.txt ├── setup.py └── src ├── __init__.py └── raft_baselines ├── classifiers ├── __init__.py ├── adaboost_classifier.py ├── classifier.py ├── gpt3_classifier.py ├── in_context_classifier.py ├── n_grams_classifier.py ├── naive_bayes_classifier.py ├── random_classifier.py ├── svm_classifier.py ├── transformers_causal_lm_classifier.py └── zero_shot_transformers_classifier.py ├── data ├── __init__.py ├── example_predictions.csv └── prompt_construction_settings.jsonl ├── scripts ├── non_neural_experiment.py ├── raft_predict.py ├── raft_train_experiment.py ├── starter_kit.ipynb ├── test_gpt3.py └── test_naive_bayes.py └── utils ├── embedders.py ├── gpt3_utils.py └── tokenizers.py /.env-example: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/.env-example -------------------------------------------------------------------------------- /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/.gitignore -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/README.md -------------------------------------------------------------------------------- /example_prompts/ade_corpus_v2.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/ade_corpus_v2.txt -------------------------------------------------------------------------------- /example_prompts/banking_77.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/banking_77.txt -------------------------------------------------------------------------------- /example_prompts/neurips_impact_statement_risks.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/neurips_impact_statement_risks.txt -------------------------------------------------------------------------------- /example_prompts/one_stop_english.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/one_stop_english.txt -------------------------------------------------------------------------------- /example_prompts/overruling.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/overruling.txt -------------------------------------------------------------------------------- /example_prompts/semiconductor_org_types.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/semiconductor_org_types.txt -------------------------------------------------------------------------------- /example_prompts/systematic_review_inclusion.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/systematic_review_inclusion.txt -------------------------------------------------------------------------------- /example_prompts/tai_safety_research.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/tai_safety_research.txt -------------------------------------------------------------------------------- /example_prompts/terms_of_service.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/terms_of_service.txt -------------------------------------------------------------------------------- /example_prompts/tweet_eval_hate.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/tweet_eval_hate.txt -------------------------------------------------------------------------------- /example_prompts/twitter_complaints.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/example_prompts/twitter_complaints.txt -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/requirements.txt -------------------------------------------------------------------------------- /setup.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/setup.py -------------------------------------------------------------------------------- /src/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/__init__.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/adaboost_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/adaboost_classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/gpt3_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/gpt3_classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/in_context_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/in_context_classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/n_grams_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/n_grams_classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/naive_bayes_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/naive_bayes_classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/random_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/random_classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/svm_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/svm_classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/transformers_causal_lm_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/transformers_causal_lm_classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/classifiers/zero_shot_transformers_classifier.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/classifiers/zero_shot_transformers_classifier.py -------------------------------------------------------------------------------- /src/raft_baselines/data/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /src/raft_baselines/data/example_predictions.csv: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/data/example_predictions.csv -------------------------------------------------------------------------------- /src/raft_baselines/data/prompt_construction_settings.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/data/prompt_construction_settings.jsonl -------------------------------------------------------------------------------- /src/raft_baselines/scripts/non_neural_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/scripts/non_neural_experiment.py -------------------------------------------------------------------------------- /src/raft_baselines/scripts/raft_predict.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/scripts/raft_predict.py -------------------------------------------------------------------------------- /src/raft_baselines/scripts/raft_train_experiment.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/scripts/raft_train_experiment.py -------------------------------------------------------------------------------- /src/raft_baselines/scripts/starter_kit.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/scripts/starter_kit.ipynb -------------------------------------------------------------------------------- /src/raft_baselines/scripts/test_gpt3.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/scripts/test_gpt3.py -------------------------------------------------------------------------------- /src/raft_baselines/scripts/test_naive_bayes.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/scripts/test_naive_bayes.py -------------------------------------------------------------------------------- /src/raft_baselines/utils/embedders.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/utils/embedders.py -------------------------------------------------------------------------------- /src/raft_baselines/utils/gpt3_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/utils/gpt3_utils.py -------------------------------------------------------------------------------- /src/raft_baselines/utils/tokenizers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/oughtinc/raft-baselines/HEAD/src/raft_baselines/utils/tokenizers.py --------------------------------------------------------------------------------