├── .gitignore ├── LICENSE ├── README.md ├── book.txt ├── book_chunks.json ├── book_chunks_with_summaries.json ├── chromadb ├── chroma-collections.parquet ├── chroma-embeddings.parquet └── index │ ├── id_to_uuid_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.pkl │ ├── index_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.bin │ ├── index_metadata_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.pkl │ └── uuid_to_id_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.pkl ├── step01_chunk_book.py ├── step02_store_in_chromadb.py ├── step03_summarize_chunks.py ├── step04_nltk_keywords.py └── system_summary.txt /.gitignore: -------------------------------------------------------------------------------- 1 | key_openai.txt -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/README.md -------------------------------------------------------------------------------- /book.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/book.txt -------------------------------------------------------------------------------- /book_chunks.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/book_chunks.json -------------------------------------------------------------------------------- /book_chunks_with_summaries.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/book_chunks_with_summaries.json -------------------------------------------------------------------------------- /chromadb/chroma-collections.parquet: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/chromadb/chroma-collections.parquet -------------------------------------------------------------------------------- /chromadb/chroma-embeddings.parquet: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/chromadb/chroma-embeddings.parquet -------------------------------------------------------------------------------- /chromadb/index/id_to_uuid_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/chromadb/index/id_to_uuid_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.pkl -------------------------------------------------------------------------------- /chromadb/index/index_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.bin: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/chromadb/index/index_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.bin -------------------------------------------------------------------------------- /chromadb/index/index_metadata_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/chromadb/index/index_metadata_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.pkl -------------------------------------------------------------------------------- /chromadb/index/uuid_to_id_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.pkl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/chromadb/index/uuid_to_id_c234a329-5c6f-4ffe-9d74-b453fc6ffaa3.pkl -------------------------------------------------------------------------------- /step01_chunk_book.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/step01_chunk_book.py -------------------------------------------------------------------------------- /step02_store_in_chromadb.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/step02_store_in_chromadb.py -------------------------------------------------------------------------------- /step03_summarize_chunks.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/step03_summarize_chunks.py -------------------------------------------------------------------------------- /step04_nltk_keywords.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/step04_nltk_keywords.py -------------------------------------------------------------------------------- /system_summary.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/daveshap/Hierarchical_Document_Representation/HEAD/system_summary.txt --------------------------------------------------------------------------------