├── .gitignore ├── .gitmodules ├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── amazon_comprehend_events_tutorial ├── README.md ├── data │ └── sample_finance_dataset.txt └── notebooks │ ├── compact_nx.html │ ├── comprehend-2017-11-27.normal.json │ ├── comprehend_events_finance_tutorial.ipynb │ ├── events_graph.py │ ├── nx.html │ └── requirements.txt ├── amazon_comprehend_moderation ├── amazon_comprehend_chain.ipynb ├── moderated_chat.ipynb └── moderation_default_01.png ├── comprehend_groundtruth_integration ├── README.md └── src │ ├── __init__.py │ └── comprehend_customer_scripts │ ├── GroundTruth │ ├── DocumentClassifier │ │ ├── __init__.py │ │ ├── __pycache__ │ │ │ ├── customer_errors.cpython-37.pyc │ │ │ └── groundtruth_to_comprehend_clr_format_converter.cpython-37.pyc │ │ ├── convertGroundTruthToComprehendCLRFormat.sh │ │ ├── customer_errors.py │ │ ├── groundtruth_format_conversion_handler.py │ │ └── groundtruth_to_comprehend_clr_format_converter.py │ ├── EntityRecognizer │ │ ├── __init__.py │ │ ├── convertGroundtruthToComprehendERFormat.sh │ │ ├── customer_errors.py │ │ ├── groundtruth_format_conversion_handler.py │ │ └── groundtruth_to_comprehend_format_converter.py │ ├── __init__.py │ └── __pycache__ │ │ ├── customer_errors.cpython-37.pyc │ │ └── groundtruth_to_comprehend_format_converter.cpython-37.pyc │ ├── __init__.py │ └── validation │ ├── __init__.py │ └── semi_structured │ ├── __init__.py │ └── entity_recognizer │ ├── README.md │ ├── __init__.py │ ├── annotation_model.py │ ├── utils │ ├── __init__.py │ ├── __pycache__ │ │ ├── __init__.cpython-38.pyc │ │ ├── annotation_utils.cpython-38.pyc │ │ ├── log_utils.cpython-38.pyc │ │ └── s3_utils.cpython-38.pyc │ ├── annotation_utils.py │ ├── log_utils.py │ └── s3_utils.py │ ├── validate_annotation.py │ └── validate_manifest.py ├── s3_object_lambda_pii_protection_blog ├── access-control │ ├── innocuous.txt │ ├── s3olap-access-control-foundation.yaml │ └── survey-results.txt └── redaction │ ├── s3olap-redaction-foundation.yaml │ └── transcript.txt └── topic_wise_review_analysis ├── data_processing.ipynb ├── model_training.ipynb └── topic_mapping_sentiment_generation.ipynb /.gitignore: -------------------------------------------------------------------------------- 1 | .ipynb_checkpoints 2 | .DS_Store -------------------------------------------------------------------------------- /.gitmodules: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/.gitmodules -------------------------------------------------------------------------------- /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/CONTRIBUTING.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/README.md -------------------------------------------------------------------------------- /amazon_comprehend_events_tutorial/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_events_tutorial/README.md -------------------------------------------------------------------------------- /amazon_comprehend_events_tutorial/data/sample_finance_dataset.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_events_tutorial/data/sample_finance_dataset.txt -------------------------------------------------------------------------------- /amazon_comprehend_events_tutorial/notebooks/compact_nx.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_events_tutorial/notebooks/compact_nx.html -------------------------------------------------------------------------------- /amazon_comprehend_events_tutorial/notebooks/comprehend-2017-11-27.normal.json: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_events_tutorial/notebooks/comprehend-2017-11-27.normal.json -------------------------------------------------------------------------------- /amazon_comprehend_events_tutorial/notebooks/comprehend_events_finance_tutorial.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_events_tutorial/notebooks/comprehend_events_finance_tutorial.ipynb -------------------------------------------------------------------------------- /amazon_comprehend_events_tutorial/notebooks/events_graph.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_events_tutorial/notebooks/events_graph.py -------------------------------------------------------------------------------- /amazon_comprehend_events_tutorial/notebooks/nx.html: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_events_tutorial/notebooks/nx.html -------------------------------------------------------------------------------- /amazon_comprehend_events_tutorial/notebooks/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_events_tutorial/notebooks/requirements.txt -------------------------------------------------------------------------------- /amazon_comprehend_moderation/amazon_comprehend_chain.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_moderation/amazon_comprehend_chain.ipynb -------------------------------------------------------------------------------- /amazon_comprehend_moderation/moderated_chat.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_moderation/moderated_chat.ipynb -------------------------------------------------------------------------------- /amazon_comprehend_moderation/moderation_default_01.png: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/amazon_comprehend_moderation/moderation_default_01.png -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/README.md -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/__pycache__/customer_errors.cpython-37.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/__pycache__/customer_errors.cpython-37.pyc -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/__pycache__/groundtruth_to_comprehend_clr_format_converter.cpython-37.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/__pycache__/groundtruth_to_comprehend_clr_format_converter.cpython-37.pyc -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/convertGroundTruthToComprehendCLRFormat.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/convertGroundTruthToComprehendCLRFormat.sh -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/customer_errors.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/customer_errors.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/groundtruth_format_conversion_handler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/groundtruth_format_conversion_handler.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/groundtruth_to_comprehend_clr_format_converter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/DocumentClassifier/groundtruth_to_comprehend_clr_format_converter.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer/convertGroundtruthToComprehendERFormat.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer/convertGroundtruthToComprehendERFormat.sh -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer/customer_errors.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer/customer_errors.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer/groundtruth_format_conversion_handler.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer/groundtruth_format_conversion_handler.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer/groundtruth_to_comprehend_format_converter.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/EntityRecognizer/groundtruth_to_comprehend_format_converter.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/__pycache__/customer_errors.cpython-37.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/__pycache__/customer_errors.cpython-37.pyc -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/__pycache__/groundtruth_to_comprehend_format_converter.cpython-37.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/GroundTruth/__pycache__/groundtruth_to_comprehend_format_converter.cpython-37.pyc -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/README.md -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/__init__.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/__init__.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/annotation_model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/annotation_model.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/__pycache__/__init__.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/__pycache__/__init__.cpython-38.pyc -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/__pycache__/annotation_utils.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/__pycache__/annotation_utils.cpython-38.pyc -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/__pycache__/log_utils.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/__pycache__/log_utils.cpython-38.pyc -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/__pycache__/s3_utils.cpython-38.pyc: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/__pycache__/s3_utils.cpython-38.pyc -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/annotation_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/annotation_utils.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/log_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/log_utils.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/s3_utils.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/utils/s3_utils.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/validate_annotation.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/validate_annotation.py -------------------------------------------------------------------------------- /comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/validate_manifest.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/comprehend_groundtruth_integration/src/comprehend_customer_scripts/validation/semi_structured/entity_recognizer/validate_manifest.py -------------------------------------------------------------------------------- /s3_object_lambda_pii_protection_blog/access-control/innocuous.txt: -------------------------------------------------------------------------------- 1 | no PII here! -------------------------------------------------------------------------------- /s3_object_lambda_pii_protection_blog/access-control/s3olap-access-control-foundation.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/s3_object_lambda_pii_protection_blog/access-control/s3olap-access-control-foundation.yaml -------------------------------------------------------------------------------- /s3_object_lambda_pii_protection_blog/access-control/survey-results.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/s3_object_lambda_pii_protection_blog/access-control/survey-results.txt -------------------------------------------------------------------------------- /s3_object_lambda_pii_protection_blog/redaction/s3olap-redaction-foundation.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/s3_object_lambda_pii_protection_blog/redaction/s3olap-redaction-foundation.yaml -------------------------------------------------------------------------------- /s3_object_lambda_pii_protection_blog/redaction/transcript.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/s3_object_lambda_pii_protection_blog/redaction/transcript.txt -------------------------------------------------------------------------------- /topic_wise_review_analysis/data_processing.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/topic_wise_review_analysis/data_processing.ipynb -------------------------------------------------------------------------------- /topic_wise_review_analysis/model_training.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/topic_wise_review_analysis/model_training.ipynb -------------------------------------------------------------------------------- /topic_wise_review_analysis/topic_mapping_sentiment_generation.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/amazon-comprehend-examples/HEAD/topic_wise_review_analysis/topic_mapping_sentiment_generation.ipynb --------------------------------------------------------------------------------