├── CODEOWNERS ├── CODE_OF_CONDUCT.md ├── Eval_Benchmarking.ipynb ├── LICENSE ├── README.md ├── Results_Visualization.ipynb ├── SECURITY.md ├── SummHay_Illustration.png ├── SummHay_Results_Table.png ├── data ├── eval_benchmark_data.json ├── topic_conv1.json ├── topic_conv2.json ├── topic_conv3.json ├── topic_conv4.json ├── topic_conv5.json ├── topic_news1.json ├── topic_news2.json ├── topic_news3.json ├── topic_news4.json └── topic_news5.json ├── populate_eval.py ├── populate_retriever_scores.py ├── populate_summaries.py ├── prompts ├── eval_summhay.txt ├── summarization_conv.txt └── summarization_news.txt ├── requirements.txt ├── utils_eval.py ├── utils_misc.py └── utils_topic.py /CODEOWNERS: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/CODEOWNERS -------------------------------------------------------------------------------- /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /Eval_Benchmarking.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/Eval_Benchmarking.ipynb -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/README.md -------------------------------------------------------------------------------- /Results_Visualization.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/Results_Visualization.ipynb -------------------------------------------------------------------------------- /SECURITY.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/SECURITY.md -------------------------------------------------------------------------------- /SummHay_Illustration.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/SummHay_Illustration.png -------------------------------------------------------------------------------- /SummHay_Results_Table.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/SummHay_Results_Table.png -------------------------------------------------------------------------------- /data/eval_benchmark_data.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/eval_benchmark_data.json -------------------------------------------------------------------------------- /data/topic_conv1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_conv1.json -------------------------------------------------------------------------------- /data/topic_conv2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_conv2.json -------------------------------------------------------------------------------- /data/topic_conv3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_conv3.json -------------------------------------------------------------------------------- /data/topic_conv4.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_conv4.json -------------------------------------------------------------------------------- /data/topic_conv5.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_conv5.json -------------------------------------------------------------------------------- /data/topic_news1.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_news1.json -------------------------------------------------------------------------------- /data/topic_news2.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_news2.json -------------------------------------------------------------------------------- /data/topic_news3.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_news3.json -------------------------------------------------------------------------------- /data/topic_news4.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_news4.json -------------------------------------------------------------------------------- /data/topic_news5.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/data/topic_news5.json -------------------------------------------------------------------------------- /populate_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/populate_eval.py -------------------------------------------------------------------------------- /populate_retriever_scores.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/populate_retriever_scores.py -------------------------------------------------------------------------------- /populate_summaries.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/populate_summaries.py -------------------------------------------------------------------------------- /prompts/eval_summhay.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/prompts/eval_summhay.txt -------------------------------------------------------------------------------- /prompts/summarization_conv.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/prompts/summarization_conv.txt -------------------------------------------------------------------------------- /prompts/summarization_news.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/prompts/summarization_news.txt -------------------------------------------------------------------------------- /requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/requirements.txt -------------------------------------------------------------------------------- /utils_eval.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/utils_eval.py -------------------------------------------------------------------------------- /utils_misc.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/utils_misc.py -------------------------------------------------------------------------------- /utils_topic.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/salesforce/summary-of-a-haystack/HEAD/utils_topic.py --------------------------------------------------------------------------------