├── .gitignore ├── CODE_OF_CONDUCT.md ├── CONTRIBUTING.md ├── LICENSE ├── README.md ├── lab-00-setup └── Lab_0_Warm_Up_Deploy_EmbeddingModel_Llama31_on_Nvidia.ipynb ├── lab-01-intro-to-studio └── Lab_1_Setup_a_LLM_Playground_on_SageMaker_Studio.ipynb ├── lab-02-prompt-engineering └── Lab_2_Prompt_Engineering_with_Sagemaker_Studio.ipynb ├── lab-03-rag ├── AWSGuides │ ├── AmazonSageMakerDeveloperGuide.pdf │ ├── EC2DeveloperGuide.pdf │ └── S3DeveloperGuide.pdf ├── Lab_3_RAG_on_SageMaker_Studio_using_EMR.ipynb └── media │ ├── EMR-Doc-Read.jpg │ └── PageLevelProcessingEMRPDFtoTxt.jpg ├── lab-04-finetuning ├── local-finetune │ ├── deploy_llama2.py │ ├── local_fine_tune_llama2.py │ ├── post-deploy-inference-comparison.ipynb │ ├── post-deploy-inference.ipynb │ └── setup.sh ├── trainingjob-finetune │ └── Lab_4c_FM_FineTune_on_LocalMode_SageMaker_Studio.ipynb └── trn1-finetune │ ├── deploy_llama2_inf2.py │ ├── fine_tune_llama2_trn1.py │ └── setup.sh ├── lab-05-llm-eval ├── Lab_5_FM_Eval_on_SageMaker_Studio.ipynb └── sample-datasets │ ├── classification_test_clothes.jsonl │ ├── crows_pairs_sample.jsonl │ ├── real_toxicity_sample.jsonl │ ├── trex_sample.jsonl │ └── xsum_sample.jsonl ├── media └── SageMakerStudioBannerResized.jpg ├── studio-local-ui ├── chat_app.py ├── rag_app.py └── requirements.txt ├── use-cases ├── dpo │ ├── RLHF-with-Llama3-on-Studio-DPO.ipynb │ ├── example_bank_questions.txt │ └── utils │ │ └── ranker.py ├── finance_tuning │ ├── AIM302-CodeTalk-Llama3-NYCSummit-2024-Summary-MLFlow.ipynb │ ├── README.MD │ ├── chat_app.py │ ├── model │ │ ├── model.py │ │ └── requirements.txt │ ├── samples-to-test │ │ ├── sample_prompt1.txt │ │ ├── sample_prompt2.txt │ │ └── sample_prompt3.txt │ └── utils │ │ ├── __init__.py │ │ └── helper.py ├── pyspark-langchain-rag-processor │ ├── AWSGuides │ │ ├── AmazonSageMakerDeveloperGuide.pdf │ │ ├── EC2DeveloperGuide.pdf │ │ └── S3DeveloperGuide.pdf │ └── Offline_RAG_Processor_on_SageMaker_Studio_using_EMR-Serverless.ipynb └── text_to_sql │ ├── Use_case_text_to_sql_HuggingFace_SQLCoder.ipynb │ ├── database-prompts │ └── Airlines_Dataset.prompt │ └── deepspeed-djl-serving-7b │ ├── model.py │ ├── requirements.txt │ └── serving.properties ├── utils ├── __init__.py └── helpers.py └── workshop-artifacts └── cfn └── workshop-cfn.yaml /.gitignore: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/.gitignore -------------------------------------------------------------------------------- /CODE_OF_CONDUCT.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/CODE_OF_CONDUCT.md -------------------------------------------------------------------------------- /CONTRIBUTING.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/CONTRIBUTING.md -------------------------------------------------------------------------------- /LICENSE: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/LICENSE -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/README.md -------------------------------------------------------------------------------- /lab-00-setup/Lab_0_Warm_Up_Deploy_EmbeddingModel_Llama31_on_Nvidia.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-00-setup/Lab_0_Warm_Up_Deploy_EmbeddingModel_Llama31_on_Nvidia.ipynb -------------------------------------------------------------------------------- /lab-01-intro-to-studio/Lab_1_Setup_a_LLM_Playground_on_SageMaker_Studio.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-01-intro-to-studio/Lab_1_Setup_a_LLM_Playground_on_SageMaker_Studio.ipynb -------------------------------------------------------------------------------- /lab-02-prompt-engineering/Lab_2_Prompt_Engineering_with_Sagemaker_Studio.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-02-prompt-engineering/Lab_2_Prompt_Engineering_with_Sagemaker_Studio.ipynb -------------------------------------------------------------------------------- /lab-03-rag/AWSGuides/AmazonSageMakerDeveloperGuide.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-03-rag/AWSGuides/AmazonSageMakerDeveloperGuide.pdf -------------------------------------------------------------------------------- /lab-03-rag/AWSGuides/EC2DeveloperGuide.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-03-rag/AWSGuides/EC2DeveloperGuide.pdf -------------------------------------------------------------------------------- /lab-03-rag/AWSGuides/S3DeveloperGuide.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-03-rag/AWSGuides/S3DeveloperGuide.pdf -------------------------------------------------------------------------------- /lab-03-rag/Lab_3_RAG_on_SageMaker_Studio_using_EMR.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-03-rag/Lab_3_RAG_on_SageMaker_Studio_using_EMR.ipynb -------------------------------------------------------------------------------- /lab-03-rag/media/EMR-Doc-Read.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-03-rag/media/EMR-Doc-Read.jpg -------------------------------------------------------------------------------- /lab-03-rag/media/PageLevelProcessingEMRPDFtoTxt.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-03-rag/media/PageLevelProcessingEMRPDFtoTxt.jpg -------------------------------------------------------------------------------- /lab-04-finetuning/local-finetune/deploy_llama2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-04-finetuning/local-finetune/deploy_llama2.py -------------------------------------------------------------------------------- /lab-04-finetuning/local-finetune/local_fine_tune_llama2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-04-finetuning/local-finetune/local_fine_tune_llama2.py -------------------------------------------------------------------------------- /lab-04-finetuning/local-finetune/post-deploy-inference-comparison.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-04-finetuning/local-finetune/post-deploy-inference-comparison.ipynb -------------------------------------------------------------------------------- /lab-04-finetuning/local-finetune/post-deploy-inference.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-04-finetuning/local-finetune/post-deploy-inference.ipynb -------------------------------------------------------------------------------- /lab-04-finetuning/local-finetune/setup.sh: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-04-finetuning/local-finetune/setup.sh -------------------------------------------------------------------------------- /lab-04-finetuning/trainingjob-finetune/Lab_4c_FM_FineTune_on_LocalMode_SageMaker_Studio.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-04-finetuning/trainingjob-finetune/Lab_4c_FM_FineTune_on_LocalMode_SageMaker_Studio.ipynb -------------------------------------------------------------------------------- /lab-04-finetuning/trn1-finetune/deploy_llama2_inf2.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-04-finetuning/trn1-finetune/deploy_llama2_inf2.py -------------------------------------------------------------------------------- /lab-04-finetuning/trn1-finetune/fine_tune_llama2_trn1.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-04-finetuning/trn1-finetune/fine_tune_llama2_trn1.py -------------------------------------------------------------------------------- /lab-04-finetuning/trn1-finetune/setup.sh: -------------------------------------------------------------------------------- 1 | pip install --upgrade pyfiglet "sagemaker==2.198.0" datasets -------------------------------------------------------------------------------- /lab-05-llm-eval/Lab_5_FM_Eval_on_SageMaker_Studio.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-05-llm-eval/Lab_5_FM_Eval_on_SageMaker_Studio.ipynb -------------------------------------------------------------------------------- /lab-05-llm-eval/sample-datasets/classification_test_clothes.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-05-llm-eval/sample-datasets/classification_test_clothes.jsonl -------------------------------------------------------------------------------- /lab-05-llm-eval/sample-datasets/crows_pairs_sample.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-05-llm-eval/sample-datasets/crows_pairs_sample.jsonl -------------------------------------------------------------------------------- /lab-05-llm-eval/sample-datasets/real_toxicity_sample.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-05-llm-eval/sample-datasets/real_toxicity_sample.jsonl -------------------------------------------------------------------------------- /lab-05-llm-eval/sample-datasets/trex_sample.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-05-llm-eval/sample-datasets/trex_sample.jsonl -------------------------------------------------------------------------------- /lab-05-llm-eval/sample-datasets/xsum_sample.jsonl: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/lab-05-llm-eval/sample-datasets/xsum_sample.jsonl -------------------------------------------------------------------------------- /media/SageMakerStudioBannerResized.jpg: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/media/SageMakerStudioBannerResized.jpg -------------------------------------------------------------------------------- /studio-local-ui/chat_app.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/studio-local-ui/chat_app.py -------------------------------------------------------------------------------- /studio-local-ui/rag_app.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/studio-local-ui/rag_app.py -------------------------------------------------------------------------------- /studio-local-ui/requirements.txt: -------------------------------------------------------------------------------- 1 | streamlit 2 | langchain 3 | wikipedia 4 | numexpr 5 | opensearch-py==2.3.2 -------------------------------------------------------------------------------- /use-cases/dpo/RLHF-with-Llama3-on-Studio-DPO.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/dpo/RLHF-with-Llama3-on-Studio-DPO.ipynb -------------------------------------------------------------------------------- /use-cases/dpo/example_bank_questions.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/dpo/example_bank_questions.txt -------------------------------------------------------------------------------- /use-cases/dpo/utils/ranker.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/dpo/utils/ranker.py -------------------------------------------------------------------------------- /use-cases/finance_tuning/AIM302-CodeTalk-Llama3-NYCSummit-2024-Summary-MLFlow.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/finance_tuning/AIM302-CodeTalk-Llama3-NYCSummit-2024-Summary-MLFlow.ipynb -------------------------------------------------------------------------------- /use-cases/finance_tuning/README.MD: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/finance_tuning/README.MD -------------------------------------------------------------------------------- /use-cases/finance_tuning/chat_app.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/finance_tuning/chat_app.py -------------------------------------------------------------------------------- /use-cases/finance_tuning/model/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/finance_tuning/model/model.py -------------------------------------------------------------------------------- /use-cases/finance_tuning/model/requirements.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/finance_tuning/model/requirements.txt -------------------------------------------------------------------------------- /use-cases/finance_tuning/samples-to-test/sample_prompt1.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/finance_tuning/samples-to-test/sample_prompt1.txt -------------------------------------------------------------------------------- /use-cases/finance_tuning/samples-to-test/sample_prompt2.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/finance_tuning/samples-to-test/sample_prompt2.txt -------------------------------------------------------------------------------- /use-cases/finance_tuning/samples-to-test/sample_prompt3.txt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/finance_tuning/samples-to-test/sample_prompt3.txt -------------------------------------------------------------------------------- /use-cases/finance_tuning/utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /use-cases/finance_tuning/utils/helper.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/finance_tuning/utils/helper.py -------------------------------------------------------------------------------- /use-cases/pyspark-langchain-rag-processor/AWSGuides/AmazonSageMakerDeveloperGuide.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/pyspark-langchain-rag-processor/AWSGuides/AmazonSageMakerDeveloperGuide.pdf -------------------------------------------------------------------------------- /use-cases/pyspark-langchain-rag-processor/AWSGuides/EC2DeveloperGuide.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/pyspark-langchain-rag-processor/AWSGuides/EC2DeveloperGuide.pdf -------------------------------------------------------------------------------- /use-cases/pyspark-langchain-rag-processor/AWSGuides/S3DeveloperGuide.pdf: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/pyspark-langchain-rag-processor/AWSGuides/S3DeveloperGuide.pdf -------------------------------------------------------------------------------- /use-cases/pyspark-langchain-rag-processor/Offline_RAG_Processor_on_SageMaker_Studio_using_EMR-Serverless.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/pyspark-langchain-rag-processor/Offline_RAG_Processor_on_SageMaker_Studio_using_EMR-Serverless.ipynb -------------------------------------------------------------------------------- /use-cases/text_to_sql/Use_case_text_to_sql_HuggingFace_SQLCoder.ipynb: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/text_to_sql/Use_case_text_to_sql_HuggingFace_SQLCoder.ipynb -------------------------------------------------------------------------------- /use-cases/text_to_sql/database-prompts/Airlines_Dataset.prompt: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/text_to_sql/database-prompts/Airlines_Dataset.prompt -------------------------------------------------------------------------------- /use-cases/text_to_sql/deepspeed-djl-serving-7b/model.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/text_to_sql/deepspeed-djl-serving-7b/model.py -------------------------------------------------------------------------------- /use-cases/text_to_sql/deepspeed-djl-serving-7b/requirements.txt: -------------------------------------------------------------------------------- 1 | boto3 2 | sqlparse 3 | -------------------------------------------------------------------------------- /use-cases/text_to_sql/deepspeed-djl-serving-7b/serving.properties: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/use-cases/text_to_sql/deepspeed-djl-serving-7b/serving.properties -------------------------------------------------------------------------------- /utils/__init__.py: -------------------------------------------------------------------------------- 1 | -------------------------------------------------------------------------------- /utils/helpers.py: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/utils/helpers.py -------------------------------------------------------------------------------- /workshop-artifacts/cfn/workshop-cfn.yaml: -------------------------------------------------------------------------------- https://raw.githubusercontent.com/aws-samples/sagemaker-studio-foundation-models/HEAD/workshop-artifacts/cfn/workshop-cfn.yaml --------------------------------------------------------------------------------