├── Introduction to Containers with AWS.md ├── Introduction to Data (Databases, Analytics, Blockchain) with AWS - Part 1.md ├── Introduction to Data (Databases, Analytics, Blockchain) with AWS - Part 2.md ├── Introduction to Developer Tools with AWS.md ├── Introduction to Game Tech with AWS.md ├── Introduction to Machine Learning with AWS - Part 1.md ├── Introduction to Machine Learning with AWS - Part 2.md ├── Introduction to Machine Learning with AWS - Part 3.md ├── Introduction to Management, Governance and Migration with AWS - Part 1.md ├── Introduction to Management, Governance and Migration with AWS - Part 2.md ├── Introduction to Mobile and Web Apps with AWS.md ├── Introduction to Networking and Content Delivery with AWS.md ├── Introduction to Security, Identity, and Compliance with AWS.md ├── Introduction to Serverless with AWS.md ├── Introduction to Storage with AWS.md └── README.md /Introduction to Containers with AWS.md: -------------------------------------------------------------------------------- 1 | **Containerization**—a virtualization method used to deploy and run distributed applications without the need to launch an entire virtual machine for each application—is changing the way businesses develop and deploy applications in cloud environments. Containers decompose applications into small, manageable packages containing everything the application needs to run: code, core data, configuration files, interfaces, and dependencies. 2 | 3 | The container approach allows developers to focus on applications and not be concerned with deployment and infrastructure management. From a development perspective, there are numerous benefits to the container approach. 4 | 5 | Accelerate the development pipeline, including testing and debugging. 6 | Facilitate **continuous integration (CI) **and **continuous deployment (CD)** workflows, automatically rebuilding whenever a new code revision is committed. 7 | 8 | Containers run locally on desktop or laptop and are easily uploaded directly to the Cloud. 9 | Consistent results when moving code from development to test to production systems. 10 | 11 | No need to rewrite code for each OS and cloud platform, making it easy to move containers from one cloud provider to another. 12 | The advantages of containers extend beyond the development cycle. Containers utilize compute resources more efficiently by eliminating the need for a hypervisor. 13 | 14 | They simply share OS kernel without impacting the performance of applications running inside the container. With a smaller footprint, more containers can run on a single host, resulting in better utilization of compute resources and lower costs. 15 | 16 | Additionally, containers can be configured with only the desired binaries and components, eliminating potential vulnerabilities that might be found in a full fledged OS. Containers that can run on **Amazon EC2 Spot Instances can obtain up to a 90% discount compared to On-Demand 17 | prices.** 18 | 19 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/00d9zw36vvqfaa57xap3.png) 20 | 21 | 22 | *My Background: I am Cloud , DevOps & Big Data Enthusiast | 4x AWS Certified | 3x OCI Certified | 3x Azure Certified .* 23 | 24 | The Introduction to AWS is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 25 | 26 | 27 | There are a bunch of different ways to run your **containerized workloads on AWS.** This blog post compares the three most important ways to run Docker on AWS: 28 | 29 | #### 1.)Amazon Elastic Container Service (ECS) with AWS Fargate 30 | 31 | #### 2.)Amazon Elastic Container Service for Kubernetes (EKS) 32 | 33 | #### 3.)AWS Elastic Beanstalk (EB) with Single Container Docker 34 | 35 | ![Alt Text](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/jzo3tz8l9g0i3ukhp1vp.png) 36 | 37 | ## ECS with Fargate 38 | 39 | First, let’s have a look at ECS, a **fully-managed container orchestration service.** ECS is a proprietary but free of charge solution offered by AWS. It is important to mention that ECS provides a high level of integration with the AWS infrastructure. For example, containers are 1st class citizens of the VPC with their network interface (ENI) and security groups. 40 | 41 | ECS offers **service discovery** via a load balancer or DNS (Cloud Map). 42 | 43 | Aside from that ECS is the only option to run Docker containers without running EC2 instances on AWS. Fargate is the compute engine for ECS. All the heavy lifting of **scaling** the number of EC2 instances and containers, rolling out updates to EC2 instances without affecting containers, and many more is gone. 44 | 45 | **ECS is free of charge.** Fargate is billed per second based on CPU and memory allocated for your containers. A container with 1 vCPU and 4 GB is about USD 30 per month. 46 | 47 | Keep in mind the following limitations of Fargate: 48 | 49 | General purpose compute capacity only. Fargate does not support GPU, CPU/memory optimized configurations at the moment. 50 | Persistent volumes are not supported out of the box (e.g., Docker volume driver). 51 | No discounts for reserved capacity available. 52 | 53 | ## EKS (Kubernetes) 54 | 55 | The 2nd option to run Docker containers on AWS is Kubernetes (K8s). In summary, K8s is an open-source container orchestration solution. AWS offers the K8s master layer as a service. The master layer is responsible for storing the state of the container cluster and deciding on which machines new containers should be placed. On top of that, you are responsible for managing a fleet of EC2 instances used to run the containers. 56 | 57 | The **main selling point for K8s:** it is open-source and runs on AWS, Azure, Google Cloud, on-premises, or even on your local machine. The **resulting disadvantage** is that Kubernetes is not that well integrated with the AWS infrastructure. 58 | 59 | **Kubernetes is designed for microservice architectures.** For example, a built-in service discovery allows containers to talk to each other easily by using a local proxy. 60 | 61 | EKS is about USD 144 per month for the master layer. Besides, you are paying for the EC2 instances powering your containers. A t3.medium instance provides 2 CPUs with 4 GiB of memory and costs around USD 30 USD per month. 62 | 63 | You should not underestimate the complexity of operating EKS and EC2. For example, the way EKS integrates with the VPC comes with a few unexpected limitations (see EKS vs. ECS: orchestrating containers on AWS for more details). 64 | 65 | ## Elastic Beanstalk 66 | 67 | Another option to run Docker containers on AWS is Elastic Beanstalk. Some say Elastic Beanstalk is the PaaS (Platform-as-a-Service) offering from AWS. Nevertheless, Elastic Beanstalk is very easy to use. There are a bunch of environments to deploy your web application with Elastic Beanstalk. One of them is called **Single Container Docker.** This environment deploys a single Docker container to one or multiple EC2 instances. 68 | 69 | Elastic Beanstalk is not only deploying your application; it is also creating the needed infrastructure consisting of a database, a load balancer, and EC2 instances. Important to note: Elastic Beanstalk creates EC2 instances automatically. But you are still responsible for these virtual machines they are not fully-managed by AWS. 70 | 71 | Elastic Beanstalk is a proprietary but free of charge solution offered by AWS. You are only paying for the underlying infrastructure. For example, a t3.medium instance provides 2 CPUs with 4 GiB of memory and costs around USD 30 USD per month. 72 | 73 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/j0cb7pfjop11c8ywtvm5.png) 74 | 75 | 76 | ## When Is Elastic Beanstalk The Best Method For Managing Docker Containers On AWS? 77 | For businesses new to AWS or new to the containerization concept, just getting started with Docker, or developing new applications, Elastic Beanstalk may be the best approach to support Docker containers. Elastic Beanstalk offers a simple interface, allows Docker images to be pulled from public or private registries, and coordinates the deployment of multiple Docker containers to Amazon ECS clusters. Elastic Beanstalk gives you less control over application scaling and capacity but makes deploying Docker containers on AWS ever so straightforward. 78 | 79 | ## When Is Elastic Container Service The Best Method For Managing Docker Containers On AWS? 80 | 81 | In comparison to Elastic Beanstalk, Elastic Container Service provides greater control over application architectures and orchestration of Docker containers. You specify the size and number of cluster nodes and determine if auto-scaling should be used. 82 | 83 | Elastic Container Service uses tasks to launch Docker containers. A task includes the container definition, providing the ability to group containers in sets that launch together then terminate simultaneously. ECS provides significantly greater flexibility and customization in scheduling and CPU and memory utilization. In addition, ECS does not require special integration efforts to work with many other AWS services. 84 | 85 | Elastic Container Service is appropriate when you need to run microservices that require integration with other AWS services, or use custom or managed schedulers to run batch workloads on EC2 On-Demand, Reserved, or Spot Instances. Businesses wanting to containerize legacy code and migrate it to AWS without needing to rewrite code should take the ECS option. Applications or workflows comprised of loosely coupled, distributed services running on various platforms or accessing widely-distributed data source can also benefit by using Elastic Container Service. 86 | 87 | ## When Is Elastic Kubernetes Service The Best Method For Managing Docker Containers On AWS? 88 | 89 | If you want the flexibility to integrate externally with the open-source Kubernetes community, spending the additional effort on setting up EKS may be the better option. Kubernetes is preferred for legacy workloads. It allows you to build a dev/test/production environment on-premises, and then move it to the cloud if and when required. Kubernetes is best known for its true enterprise-level cluster and container management. It is extremely valuable when your containerized workloads begin to scale. If you are already running workloads on Kubernetes, EKS is going to be a familiar and simple route to moving to an AWS environment. 90 | 91 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3nu6x8k14gl8chm8mgc8.png) 92 | 93 | 94 | Hope this guide helps you understand containers on aws, feel free to connect with me on [LinkedIn.](https://www.linkedin.com/in/adit-modi-2a4362191/) 95 | You can view my badges [here.](https://www.youracclaim.com/users/adit-modi/badges) 96 | If you are interested in learning more about AWS then follow me on [github.](https://github.com/AditModi) 97 | If you liked this content then do clap and share it . Thank You . -------------------------------------------------------------------------------- /Introduction to Data (Databases, Analytics, Blockchain) with AWS - Part 1.md: -------------------------------------------------------------------------------- 1 | Data is a strategic asset of every organisation. As data continues to grow, databases are becoming increasingly pivotal to understanding data and converting it to valuable insights. IT leaders and entrepreneurs need to look at different flavours of data and based on it look for ways to get more value from their data. With the rapid growth of data — Not just in volume and velocity but also in flavours, complexity and interconnectedness — the needs of data analytics and its corresponding databases have changed. 2 | 3 | In this blog post, we will discuss some of the most important AWS analytics services that are built to handle large amounts of data at scale and automate many manual and time-consuming tasks. This services are purpose-built to give you the best performance, scale, and cost for your needs. 4 | 5 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/o75qds6xhf8by98buvzl.png) 6 | 7 | > **The Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 8 | 9 | # AWS Analytics Services 10 | 11 | * AWS is the fastest and most cost-effective place to store and analyze data. AWS provides a comprehensive set of tools that go beyond standard security functionality, like encryption and access control, to offer unified security policy management and proactive monitoring. AWS offers built-in ML integration as part of our purpose-built analytics services. 12 | 13 | ## Amazon Athena 14 | 15 | 16 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/drigofz9l0dhlkvkboj4.png) 17 | 18 | * Amazon Athena is an interactive query service that makes it easy to analyze data in Amazon S3 using standard SQL. Athena is serverless, so there is no infrastructure to manage, and you pay only for the queries that you run. 19 | 20 | * Athena is easy to use. Simply point to your data in Amazon S3, define the schema, and start querying using standard SQL. Most results are delivered within seconds. With Athena, there’s no need for complex extract, transform, and load (ETL) jobs to prepare your data for analysis. This makes it easy for anyone with SQL skills to quickly analyze large-scale datasets. 21 | 22 | * Athena is out-of-the-box integrated with AWS Glue Data Catalog, allowing you to create a unified metadata repository across various services, crawl data sources to discover schemas and populate your Catalog with new and modified table and partition definitions, and maintain schema versioning. 23 | 24 | * You can also use Glue’s fully-managed ETL capabilities to transform data or convert it into columnar formats to optimize cost and improve performance. 25 | 26 | ## Amazon EMR 27 | 28 | 29 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/bwpubkmlhgv3p5q0ek3q.png) 30 | 31 | * Amazon EMR provides a managed Hadoop framework that makes it easy, fast, and cost-effective to process vast amounts of data across dynamically scalable Amazon EC2 instances. 32 | 33 | * You can also run other popular distributed frameworks such as Apache Spark, HBase, Presto, and Flink in Amazon EMR, and interact with data in other AWS data stores such as Amazon S3 and Amazon DynamoDB. 34 | 35 | * EMR Notebooks, based on the popular Jupyter Notebook, provide a development and collaboration environment for ad hoc querying and exploratory analysis. 36 | 37 | * Amazon EMR securely and reliably handles a broad set of big data use cases, including log analysis, web indexing, data transformations (ETL), machine learning, financial analysis, scientific simulation, and bioinformatics. 38 | 39 | ## Amazon CloudSearch 40 | 41 | 42 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/m4wbqt8u0hbcic7erbn2.png) 43 | 44 | * Amazon CloudSearch is a managed service in the AWS Cloud that makes it simple and cost-effective to set up, manage, and scale a search solution for your website or application. 45 | 46 | * Amazon CloudSearch supports 34 languages and popular search features such as highlighting, autocomplete, and geospatial search. 47 | 48 | ## Amazon Elasticsearch Service 49 | 50 | 51 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/97kzqg16jga5xr6d4wrv.png) 52 | 53 | * Amazon Elasticsearch Service makes it easy to deploy, secure, operate, and scale Elasticsearch to search, analyze, and visualize data in real-time. 54 | 55 | * With Amazon Elasticsearch Service, you get easy-to-use APIs and real-time analytics capabilities to power use-cases such as log analytics, full-text search, application monitoring, and clickstream analytics, with enterprise-grade availability, scalability, and security. 56 | 57 | * The service offers integrations with open-source tools like Kibana and Logstash for data ingestion and visualization. It also integrates seamlessly with other AWS services such as Amazon Virtual Private Cloud (Amazon VPC), AWS Key Management Service (AWS KMS), Amazon Kinesis Data Firehose, AWS Lambda, AWS Identity and Access Management (IAM), Amazon Cognito, and Amazon CloudWatch, so that you can go from raw data to actionable insights quickly. 58 | 59 | ## Amazon Kinesis 60 | 61 | 62 | * Amazon Kinesis makes it easy to collect, process, and analyze real-time, streaming data so you can get timely insights and react quickly to new information. 63 | 64 | * Amazon Kinesis offers key capabilities to cost-effectively process streaming data at any scale, along with the flexibility to choose the tools that best suit the requirements of your application. 65 | 66 | * With Amazon Kinesis, you can ingest real-time data such as video, audio, application logs, website clickstreams, and IoT telemetry data for machine learning, analytics, and other applications. 67 | 68 | * Amazon Kinesis enables you to process and analyze data as it arrives and respond instantly instead of having to wait until all your data is collected before the processing can begin. 69 | 70 | * Amazon Kinesis currently offers four services: Kinesis Data Firehose, Kinesis Data Analytics, Kinesis Data Streams, and Kinesis Video Streams. 71 | 72 | ### Amazon Kinesis Data Firehose 73 | 74 | 75 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/i5dszm1u0misr2kk4i72.png) 76 | 77 | 78 | * Amazon Kinesis Firehose is the easiest way to reliably load streaming data into data stores and analytics tools. It can capture, transform, and load streaming data into Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, and Splunk, enabling near real-time analytics with existing business intelligence tools and dashboards you’re already using today. 79 | 80 | * It is a fully managed service that automatically scales to match the throughput of your data and requires no ongoing administration. It can also batch, compress, transform, and encrypt the data before loading it, minimizing the amount of storage used at the destination and increasing security. 81 | 82 | * You can easily create a Firehose delivery stream from the AWS Management Console, configure it with a few clicks, and start sending data to the stream from hundreds of thousands of data sources to be loaded continuously to AWS—all in just a few minutes. 83 | 84 | * You can also configure your delivery stream to automatically convert the incoming data to columnar formats like Apache Parquet and Apache ORC, before the data is delivered to Amazon S3, for cost-effective storage and analytics. 85 | 86 | ### Amazon Kinesis Data Analytics 87 | 88 | 89 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/e0hx3ewv2fg8ysjvq0ex.png) 90 | 91 | * Amazon Kinesis Data Analytics is the easiest way to analyze streaming data, gain actionable insights, and respond to your business and customer needs in real time. 92 | 93 | * Amazon Kinesis Data Analytics reduces the complexity of building, managing, and integrating streaming applications with other AWS services. SQL users can easily query streaming data or build entire streaming applications using templates and an interactive SQL editor. 94 | 95 | * Java developers can quickly build sophisticated streaming applications using open source Java libraries and AWS integrations to transform and analyze data in real-time. 96 | 97 | * Amazon Kinesis Data Analytics takes care of everything required to run your queries continuously and scales automatically to match the volume and throughput rate of your incoming data. 98 | 99 | ### Amazon Kinesis Data Streams 100 | 101 | 102 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/lhryhl2t3daifdmbh4na.png) 103 | 104 | * Amazon Kinesis Data Streams is a massively scalable and durable real-time data streaming service. KDS can continuously capture gigabytes of data per second from hundreds of thousands of sources such as website clickstreams, database event streams, financial transactions, social media feeds, IT logs, and location-tracking events. 105 | 106 | * The data collected is available in milliseconds to enable real-time analytics use cases such as real-time dashboards, real-time anomaly detection, dynamic pricing, and more. 107 | 108 | ### Amazon Kinesis Video Streams 109 | 110 | 111 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/lrgyzzj9645fhrp3cs7e.png) 112 | 113 | * Amazon Kinesis Video Streams makes it easy to securely stream video from connected devices to AWS for analytics, machine learning (ML), playback, and other processing. Kinesis Video Streams automatically provisions and elastically scales all the infrastructure needed to ingest streaming video data from millions of devices. 114 | 115 | * It also durably stores, encrypts, and indexes video data in your streams, and allows you to access your data through easy-to-use APIs. Kinesis Video Streams enables you to playback video for live and on-demand viewing, and quickly build applications that take advantage of computer vision and video analytics through integration with Amazon Recognition Video, and libraries for ML frameworks such as Apache MxNet, TensorFlow, and OpenCV. 116 | 117 | ## Amazon Redshift 118 | 119 | 120 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/hiutpiufatxhexhsu7cy.png) 121 | 122 | * Amazon Redshift is a fast, scalable data warehouse that makes it simple and cost-effective to analyze all your data across your data warehouse and data lake. Redshift delivers ten times faster performance than other data warehouses by using machine learning, massively parallel query execution, and columnar storage on high-performance disk. 123 | 124 | * You can setup and deploy a new data warehouse in minutes, and run queries across petabytes of data in your Redshift data warehouse, and exabytes of data in your data lake built on Amazon S3. You can start small for just $0.25 per hour and scale to $250 per terabyte per year, less than one-tenth the cost of other solutions. 125 | 126 | # Amazon QuickSight 127 | 128 | 129 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/igv4cb2ei5ag1trye5ef.png) 130 | 131 | * Amazon QuickSight is a fast, cloud-powered business intelligence (BI) service that makes it easy for you to deliver insights to everyone in your organization. QuickSight lets you create and publish interactive dashboards that can be accessed from browsers or mobile devices. 132 | 133 | * You can embed dashboards into your applications, providing your customers with powerful self-service analytics. QuickSight easily scales to tens of thousands of users without any software to install, servers to deploy, or infrastructure to manage. 134 | 135 | ## AWS Data Pipeline 136 | 137 | 138 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/l1ad84y0vvfxa5n1xb3h.png) 139 | 140 | * AWS Data Pipeline is a web service that helps you reliably process and move data between different AWS compute and storage services, as well as on-premises data sources, at specified intervals. 141 | 142 | * With AWS Data Pipeline, you can regularly access your data where it’s stored, transform and process it at scale, and efficiently transfer the results to AWS services such as Amazon S3, Amazon RDS, Amazon DynamoDB, and Amazon EMR. 143 | 144 | * AWS Data Pipeline helps you easily create complex data processing workloads that are fault tolerant, repeatable, and highly available. 145 | 146 | * You don’t have to worry about ensuring resource availability, managing inter-task dependencies, retrying transient failures or timeouts in individual tasks, or creating a failure notification system. AWS Data Pipeline also allows you to move and process data that was previously locked up in on-premises data silos. 147 | 148 | ## AWS Glue 149 | 150 | 151 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/8jkwxj5mb3a876neksih.png) 152 | 153 | 154 | * AWS Glue is a fully managed extract, transform, and load (ETL) service that makes it easy for customers to prepare and load their data for analytics. You can create and run an ETL job with a few clicks in the AWS Management Console. 155 | 156 | * You simply point AWS Glue to your data stored on AWS, and AWS Glue discovers your data and stores the associated metadata (e.g. table definition and schema) in the AWS Glue Data Catalog. Once cataloged, your data is immediately searchable, queryable, and available for ETL. 157 | 158 | ## AWS Lake Formation 159 | 160 | 161 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/0lor1g58vhqttk383wbz.png) 162 | 163 | * AWS Lake Formation is a service that makes it easy to set up a secure data lake in days. A data lake is a centralized, curated, and secured repository that stores all your data, both in its original form and prepared for analysis. 164 | 165 | * A data lake enables you to break down data silos and combine different types of analytics to gain insights and guide better business decisions. 166 | 167 | * However, setting up and managing data lakes today involves a lot of manual, complicated, and time-consuming tasks. This work includes loading data from diverse sources, monitoring those data flows, setting up partitions, turning on encryption and managing keys, defining transformation jobs and monitoring their operation, re-organizing data into a columnar format, configuring access control settings, deduplicating redundant data, matching linked records, granting access to data sets, and auditing access over time. 168 | 169 | * Creating a data lake with Lake Formation is as simple as defining where your data resides and what data access and security policies you want to apply. 170 | 171 | * Lake Formation then collects and catalogs data from databases and object storage, moves the data into your new Amazon S3 data lake, cleans and classifies data using machine learning algorithms, and secures access to your sensitive data. 172 | 173 | * Your users can then access a centralized catalog of data which describes available data sets and their appropriate usage. Your users then leverage these data sets with their choice of analytics and machine learning services, like Amazon EMR for Apache Spark, Amazon Redshift, Amazon Athena, SageMaker, and Amazon QuickSight. 174 | 175 | ## Amazon Managed Streaming for Apache Kafka (Amazon MSK) 176 | 177 | 178 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/desbyzwcnnqx2lwkagst.png) 179 | 180 | 181 | * Amazon Managed Streaming for Apache Kafka (Amazon MSK) is a fully managed service that makes it easy for you to build and run applications that use Apache Kafka to process streaming data. 182 | 183 | * Apache Kafka is an open-source platform for building real-time streaming data pipelines and applications. With Amazon MSK, you can use Apache Kafka APIs to populate data lakes, stream changes to and from databases, and power machine learning and analytics applications. 184 | 185 | * Apache Kafka clusters are challenging to setup, scale, and manage in production. When you run Apache Kafka on your own, you need to provision servers, configure Apache Kafka manually, replace servers when they fail, orchestrate server patches and upgrades, architect the cluster for high availability, ensure data is durably stored and secured, setup monitoring and alarms, and carefully plan scaling events to support load changes. 186 | 187 | * Amazon MSK makes it easy for you to build and run production applications on Apache Kafka without needing Apache Kafka infrastructure management expertise. That means you spend less time managing infrastructure and more time building applications. 188 | 189 | * With a few clicks in the Amazon MSK console you can create highly available Apache Kafka clusters with settings and configuration based on Apache Kafka’s deployment best practices. 190 | 191 | * Amazon MSK automatically provisions and runs your Apache Kafka clusters. Amazon MSK continuously monitors cluster health and automatically replaces unhealthy nodes with no downtime to your application. In addition, Amazon MSK secures your Apache Kafka cluster by encrypting data at rest. 192 | 193 | # Conclusion 194 | 195 | * AWS provides the broadest selection of analytics services that fit all your data analytics needs and enables organizations of all sizes and industries to reinvent their business with data. 196 | 197 | * From data movement, data storage, data lakes, big data analytics, and machine learning (ML) to anything in between, AWS offers purpose-built services that provide the best price performance, scalability, and lowest cost. 198 | 199 | Hope this guide helps you with the Introduction to Data (Databases, Analytics, Blockchain) with AWS Part - 1. In the Next Blog Post, we will discuss more about Different Database and Blockchain Services that are available with AWS. 200 | 201 | Let me know your thoughts in the comment section 👇 202 | And if you haven't yet, make sure to follow me on below handles: 203 | 204 | 👋 **connect with me on [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/)** 205 | 🤓 **connect with me on [Twitter](https://twitter.com/adi_12_modi)** 206 | 🐱‍💻 **follow me on [github](https://github.com/AditModi)** 207 | ✍️ **Do Checkout [my blogs](https://aditmodi.hashnode.dev)** 208 | 209 | Like, share and follow me 🚀 for more content. 210 | 211 | {% user aditmodi %} -------------------------------------------------------------------------------- /Introduction to Data (Databases, Analytics, Blockchain) with AWS - Part 2.md: -------------------------------------------------------------------------------- 1 | The past fifteen years have seen an incredible shift of application workloads from on-premises data centers or colocation facilities to cloud-based computing by using services from Amazon Web Services (AWS). Companies have been able to innovate faster, serve customers better, and keep their IT spend lower by migrating to cloud-based computing. 2 | 3 | But a simple "lift and shift" to the cloud is not enough. More and more customers are looking for ways to innovate even faster by focusing on their core competencies. They are looking for a cloud provider that can be a partner as they work to deliver customer value. For many, this means more than simple compute and storage options. As a result, companies are using higher level services such as fully managed databases and serverless compute to get the most out of their cloud provider. 4 | 5 | In the previous blog post, we discussed some of the most important AWS Analytics services. In this blog post, We will talk about AWS Database services and Blockchain services. AWS Database services that help us build use case-driven, highly scalable, distributed applications suited to our specific needs. Developing blockchain and ledger applications is simpler, faster, and more efficient with AWS. 6 | 7 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/7k5jbz04va6i189nwi3k.png) 8 | 9 | > **The Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 10 | 11 | # AWS Database services 12 | 13 | AWS fully managed database services provide continuous monitoring, self-healing storage, and automated scaling to help you focus on application development. We will discuss some of the most used AWS Database services. 14 | 15 | 16 | ## Amazon Aurora 17 | 18 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/vqdkon9a0hg17gbnawc6.png) 19 | 20 | * Amazon Aurora is a MySQL and PostgreSQL compatible relational database engine that combines the speed and availability of high-end commercial databases with the simplicity and cost-effectiveness of open source databases. 21 | 22 | * Amazon Aurora is up to five times faster than standard MySQL databases and three times faster than standard PostgreSQL databases. It provides the security, availability, and reliability of commercial databases at 1/10th the cost. 23 | 24 | * Amazon Aurora is fully managed by Amazon Relational Database Service (RDS), which automates time-consuming administration tasks like hardware provisioning, database setup, patching, and backups. 25 | 26 | * Amazon Aurora features a distributed, fault-tolerant, self-healing storage system that auto-scales up to 128TB per database instance. It delivers high performance and availability with up to 15 low-latency read replicas, point-in-time recovery, continuous backup to Amazon S3, and replication across three Availability Zones (AZs). 27 | 28 | ## Amazon Relational Database Service 29 | 30 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/2aiad4qh8d4v4dr2ejhn.png) 31 | 32 | * Amazon Relational Database Service (Amazon RDS) makes it easy to set up, operate, and scale a relational database in the cloud. It provides cost-efficient and resizable capacity while automating time-consuming administration tasks such as hardware provisioning, database setup, patching and backups. 33 | 34 | * It frees you to focus on your applications so you can give them the fast performance, high availability, security and compatibility they need. 35 | 36 | * Amazon RDS is available on several database instance types - optimized for memory, performance or I/O - and provides you with six familiar database engines to choose from, including Amazon Aurora, PostgreSQL, MySQL, MariaDB, Oracle Database, and SQL Server. You can use the AWS Database Migration Service to easily migrate or replicate your existing databases to Amazon RDS. 37 | 38 | ## Amazon RDS on VMware 39 | 40 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/dd7pw9k337lyf4eeydpn.png) 41 | 42 | * Amazon Relational Database Service (Amazon RDS) on VMware lets you deploy managed databases in on-premises VMware environments using the Amazon RDS technology enjoyed by hundreds of thousands of AWS customers. 43 | 44 | * Amazon RDS provides cost-efficient and resizable capacity while automating time-consuming administration tasks including hardware provisioning, database setup, patching, and backups, freeing you to focus on your applications. 45 | 46 | * RDS on VMware brings these same benefits to your on-premises deployments, making it easy to set up, operate, and scale databases in VMware vSphere private data centers, or to migrate them to AWS. 47 | 48 | * Amazon RDS on VMware allows you to utilize the same simple interface for managing databases in on-premises VMware environments as you would use in AWS. You can easily replicate RDS on VMware databases to RDS instances in AWS, enabling low-cost hybrid deployments for disaster recovery, read replica bursting, and optional long-term backup retention in Amazon Simple Storage Service (Amazon S3). 49 | 50 | ## Amazon DynamoDB 51 | 52 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/0fozt93c2jn9ixhve1lw.png) 53 | 54 | * Amazon DynamoDB is a key-value and document database that delivers single-digit millisecond performance at any scale. It's a fully managed, multiregion, multimaster database with built-in security, backup and restore, and in-memory caching for internet-scale applications. 55 | 56 | * DynamoDB can handle more than 10 trillion requests per day and support peaks of more than 20 million requests per second. 57 | 58 | * Many of the world's fastest growing businesses such as Lyft, Airbnb, and Redfin as well as enterprises such as Samsung, Toyota, and Capital One depend on the scale and performance of DynamoDB to support their mission-critical workloads. 59 | 60 | * More than 100,000 AWS customers have chosen DynamoDB as their key-value and document database for mobile, web, gaming, ad tech, IoT, and other applications that need low-latency data access at any scale. Create a new table for your application and let DynamoDB handle the rest. 61 | 62 | ## Amazon ElastiCache 63 | 64 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/rgb5uhaxp98v8i7ybaz8.png) 65 | 66 | * Amazon ElastiCache is a web service that makes it easy to deploy, operate, and scale an in-memory cache in the cloud. The service improves the performance of web applications by allowing you to retrieve information from fast, managed, in-memory caches, instead of relying entirely on slower disk-based databases. 67 | 68 | * Amazon ElastiCache supports two open-source in-memory caching engines: 69 | 70 | **Redis -** a fast, open source, in-memory data store and cache. Amazon ElastiCache for Redis is a Redis-compatible in-memory service that delivers the ease-of-use and power of Redis along with the availability, reliability, and performance suitable for the most demanding applications. Both single-node and up to 15-shard clusters are available, enabling scalability to up to 3.55 TiB of in-memory data. ElastiCache for Redis is fully managed, scalable, and secure. This makes it an ideal candidate to power high-performance use cases such as web, mobile apps, gaming, ad-tech, and IoT. 71 | 72 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wdyilo2ubq7kvnh02smb.png) 73 | 74 | 75 | **Memcached -** a widely adopted memory object caching system. ElastiCache for Memcached is protocol compliant with Memcached, so popular tools that you use today with existing Memcached environments will work seamlessly with the service. 76 | 77 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/k5uq903q0tc6ez468xpo.png) 78 | 79 | 80 | ## Amazon Neptune 81 | 82 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/qz2yj777v6mt8jrobf7q.png) 83 | 84 | * Amazon Neptune is a fast, reliable, fully-managed graph database service that makes it easy to build and run applications that work with highly connected datasets. 85 | 86 | * The core of Amazon Neptune is a purpose-built, high-performance graph database engine optimized for storing billions of relationships and querying the graph with milliseconds latency. 87 | 88 | * Amazon Neptune supports popular graph models Property Graph and W3C's RDF, and their respective query languages Apache TinkerPop Gremlin and SPARQL, allowing you to easily build queries that efficiently navigate highly connected datasets. 89 | 90 | * Neptune powers graph use cases such as recommendation engines, fraud detection, knowledge graphs, drug discovery, and network security. 91 | 92 | * Amazon Neptune is highly available, with read replicas, point-in-time recovery, continuous backup to Amazon S3, and replication across Availability Zones. 93 | 94 | * Neptune is secure with support for encryption at rest. Neptune is fully-managed, so you no longer need to worry about database management tasks such as hardware provisioning, software patching, setup, configuration, or backups. 95 | 96 | ## Amazon Quantum Ledger Database (QLDB) 97 | 98 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ek6dwq39ohnkr2c1cvlb.png) 99 | 100 | * Amazon QLDB is a fully managed ledger database that provides a transparent, immutable, and cryptographically verifiable transaction log ‎owned by a central trusted authority. 101 | 102 | * Amazon QLDB tracks each and every application data change and maintains a complete and verifiable history of changes over time. 103 | 104 | * Ledgers are typically used to record a history of economic and financial activity in an organization. Many organizations build applications with ledger-like functionality because they want to maintain an accurate history of their applications' data, for example, tracking the history of credits and debits in banking transactions, verifying the data lineage of an insurance claim, or tracing movement of an item in a supply chain network. 105 | 106 | * Ledger applications are often implemented using custom audit tables or audit trails created in relational databases. However, building audit functionality with relational databases is time-consuming and prone to human error. 107 | 108 | * It requires custom development, and since relational databases are not inherently immutable, any unintended changes to the data are hard to track and verify. 109 | 110 | * Alternatively, blockchain frameworks, such as Hyperledger Fabric and Ethereum, can also be used as a ledger. However, this adds complexity as you need to set-up an entire blockchain network with multiple nodes, manage its infrastructure, and require the nodes to validate each transaction before it can be added to the ledger. 111 | 112 | * Amazon QLDB is a new class of database that eliminates the need to engage in the complex development effort of building your own ledger-like applications. 113 | 114 | * With QLDB, your data’s change history is immutable – it cannot be altered or deleted – and using cryptography, you can easily verify that there have been no unintended modifications to your application’s data. 115 | 116 | * QLDB uses an immutable transactional log, known as a journal, that tracks each application data change and maintains a complete and verifiable history of changes over time. QLDB is easy to use because it provides developers with a familiar SQL-like API, a flexible document data model, and full support for transactions. 117 | 118 | * QLDB is also serverless, so it automatically scales to support the demands of your application. There are no servers to manage and no read or write limits to configure. With QLDB, you only pay for what you use. 119 | 120 | ## Amazon Timestream 121 | 122 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ha7ilp8bakub29iglbzj.png) 123 | 124 | * Amazon Timestream is a fast, scalable, fully managed time series database service for IoT and operational applications that makes it easy to store and analyze trillions of events per day at 1/10th the cost of relational databases. 125 | 126 | * Driven by the rise of IoT devices, IT systems, and smart industrial machines, time-series data — data that measures how things change over time — is one of the fastest growing data types. 127 | 128 | * Time-series data has specific characteristics such as typically arriving in time order form, data is append-only, and queries are always over a time interval. While relational databases can store this data, they are inefficient at processing this data as they lack optimizations such as storing and retrieving data by time intervals. 129 | 130 | * Timestream is a purpose-built time series database that efficiently stores and processes this data by time intervals. With Timestream, you can easily store and analyze log data for DevOps, sensor data for IoT applications, and industrial telemetry data for equipment maintenance. 131 | 132 | * As your data grows over time, Timestream’s adaptive query processing engine understands its location and format, making your data simpler and faster to analyze. Timestream also automates rollups, retention, tiering, and compression of data, so you can manage your data at the lowest possible cost. 133 | 134 | * Timestream is serverless, so there are no servers to manage. It manages time-consuming tasks such as server provisioning, software patching, setup, configuration, or data retention and tiering, freeing you to focus on building your applications. 135 | 136 | ## Amazon DocumentDB (with MongoDB compatibility) 137 | 138 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/tpkgvcxac6lt03a261sw.png) 139 | 140 | * Amazon DocumentDB (with MongoDB compatibility) is a fast, scalable, highly available, and fully managed document database service that supports MongoDB workloads. 141 | 142 | * Amazon DocumentDB (with MongoDB compatibility) is designed from the ground-up to give you the performance, scalability, and availability you need when operating mission-critical MongoDB workloads at scale. 143 | 144 | * Amazon DocumentDB (with MongoDB compatibility) implements the Apache 2.0 open source MongoDB 3.6 API by emulating the responses that a MongoDB client expects from a MongoDB server, allowing you to use your existing MongoDB drivers and tools with Amazon DocumentDB (with MongoDB compatibility) . 145 | 146 | # AWS Blockchain Services 147 | 148 | * AWS Blockchain is the perfect example of fully managed services for using blockchain technology. Blockchain on AWS refers to a small yet powerful assortment of offerings that support the enterprise blockchain initiatives of organizations. 149 | 150 | * The Amazon Quantum Ledger Database, Amazon Managed Blockchain, AWS Blockchain Partners, and AWS Blockchain Templates are the prominent entries when it comes to discussions about blockchain on AWS. 151 | 152 | ## Amazon Managed Blockchain 153 | 154 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/iar9j93e5hocaifkh3gl.png) 155 | 156 | * Amazon Managed Blockchain is a fully managed service that makes it easy to create and manage scalable blockchain networks using the popular open source frameworks Hyperledger Fabric and Ethereum. 157 | 158 | * Blockchain makes it possible to build applications where multiple parties can execute transactions without the need for a trusted, central authority. 159 | 160 | * Today, building a scalable blockchain network with existing technologies is complex to set up and hard to manage. To create a blockchain network, each network member needs to manually provision hardware, install software, create and manage certificates for access control, and configure networking components. 161 | 162 | * Once the blockchain network is running, you need to continuously monitor the infrastructure and adapt to changes, such as an increase in transaction requests, or new members joining or leaving the network. 163 | 164 | # Conclusion 165 | 166 | * AWS databases deliver the high availability, reliability, and security you need for business-critical, enterprise workloads. 167 | They support multi-region, multi-primary replication, and provide full data oversight with multiple levels of security, including network isolation and end-to-end encryption. 168 | 169 | * More customers trust AWS for their blockchain and ledger technology workloads than any other cloud vendor. AWS has over 70+ validated blockchain solutions from partners who provide support to all major blockchain protocols including Hyperledger Sawtooth, Corda, DAML, Ethereum and many more. 170 | 171 | 172 | Hope this guide helps you with Introduction to Data (Databases, Analytics, Blockchain) with AWS Part - 2. 173 | 174 | Let me know your thoughts in the comment section 👇 175 | And if you haven't yet, make sure to follow me on below handles: 176 | 177 | 👋 **connect with me on [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/)** 178 | 🤓 **connect with me on [Twitter](https://twitter.com/adi_12_modi)** 179 | 🐱‍💻 **follow me on [github](https://github.com/AditModi)** 180 | ✍️ **Do Checkout [my blogs](https://aditmodi.hashnode.dev)** 181 | 182 | Like, share and follow me 🚀 for more content. 183 | 184 | {% user aditmodi %} -------------------------------------------------------------------------------- /Introduction to Developer Tools with AWS.md: -------------------------------------------------------------------------------- 1 | AWS dominates much of the cloud market and continues to release new tools and services to expand its reach, including a push in recent years to expand its array of developer tools. 2 | 3 | Companies that don't have experienced developers already on staff may struggle with the AWS tool set, but it's hard to argue against the raw computing power of Amazon's cloud. If an IT team is ready to explore the world of AWS cloud developer tools, it will want to get to know the following developer tool services mentioned in this article. 4 | 5 | ![Introduction to Developer Tools with AWS (1)](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/yiebht0an24cvdl5lltr.png) 6 | 7 | *My Background: Cloud Engineer | AWS Community Builder | AWS Educate Cloud Ambassador | 4x AWS Certified | 3x OCI Certified | 3x Azure Certified.* 8 | 9 | The Introduction to AWS is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 10 | 11 | # AWS Developer Tools 12 | 13 | The developing tool in Amazon Web Services helps the user to get the software to deliver safely. It also modifies the developers and IT operations to make the outcome better. 14 | 15 | This helps to build, test, and deploy the application to AWS or the required destination. This tool helps the user to monitor, store, and provide surveillance to the application source code. 16 | 17 | ## AWS CodeCommit 18 | 19 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/4fgr4ige6lpgdol43u12.png) 20 | 21 | AWS CodeCommit is a fully managed source control service that makes it easy for companies to host secure and highly scalable private Git repositories. AWS CodeCommit eliminates the need to operate your own source control system or worry about scaling its infrastructure. You can use AWS CodeCommit to securely store anything from source code to binaries, and it works seamlessly with your existing Git tools. 22 | 23 | ## CodeBuild 24 | 25 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/f83shlsw60jiityeuoa5.png) 26 | 27 | CodeBuild is a fully managed build service that compiles source code, runs tests, and produces software packages that are ready to deploy. With CodeBuild, you don’t need to provision, manage, and scale your own build servers. CodeBuild scales continuously and processes multiple builds concurrently, so your builds are not left waiting in a queue. You can get started quickly by using prepackaged build environments, or you can create custom build environments that use your own build tools. 28 | 29 | ## AWS CodeArtifact 30 | 31 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/88xwhmomwo3opbfm24bf.png) 32 | 33 | AWS CodeArtifact, AWS' managed artifact repository, enables developers to store, publish and share software packages in a secure manner. This service integrates with Maven, Gradle, npm, yarn and other package managers and build tools. CodeArtifact has no upfront costs but there are fees for storage, requests and data transfers. 34 | 35 | ## CodeDeploy 36 | 37 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/xrlhkoul92jdn17ilrt1.png) 38 | 39 | CodeDeploy is a service that automates code deployments to any instance, including EC2 instances and instances running on premises. CodeDeploy makes it easier for you to rapidly release new features, helps you avoid downtime during application deployment, and handles the complexity of updating your applications. You can use CodeDeploy to automate software deployments, eliminating the need for error-prone manual operations. The service scales with your infrastructure so you can easily deploy to one instance or thousands. 40 | 41 | ## CodePipeline 42 | 43 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/mcj9max1jz1gxby7nw9b.png) 44 | 45 | CodePipeline is a fully managed continuous delivery service that helps you automate your release pipelines for fast and reliable application and infrastructure updates. CodePipeline automates the build, test, and deploy phases of your release process every time there is a code change, based on the release model you define. This enables you to rapidly and reliably deliver features and updates. You can easily integrate CodePipeline with third-party services such as GitHub or with your own custom plugin. With AWS CodePipeline, you only pay for what you use. There are no upfront fees or long-term commitments. 46 | 47 | ## AWS CodeStar 48 | 49 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/b62xtsb4ibfuvf2o0xi3.png) 50 | 51 | AWS CodeStar enables you to quickly develop, build, and deploy applications on AWS. AWS CodeStar provides a unified user interface, enabling you to easily manage your software development activities in one place. With AWS CodeStar, you can set up your entire continuous delivery toolchain in minutes, allowing you to start releasing code faster. AWS CodeStar makes it easy for your whole team to work together securely, allowing you to easily manage access and add owners, contributors, and viewers to your projects. Each AWS CodeStar project comes with a project management dashboard, including an integrated issue tracking capability powered by Atlassian JIRA Software. With the AWS CodeStar project dashboard, you can easily track progress across your entire software development process, from your backlog of work items to teams’ recent code deployments. For more information, see AWS CodeStar features. 52 | 53 | ## Amazon Corretto 54 | 55 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/8qtcogljbsb04b7kiuvn.png) 56 | 57 | Amazon Corretto is a no-cost, multiplatform, production-ready distribution of the Open Java Development Kit (OpenJDK). Corretto comes with long-term support that will include performance enhancements and security fixes. Amazon runs Corretto internally on thousands of production services and Corretto is certified as compatible with the Java SE standard. With Corretto, you can develop and run Java applications on popular operating systems, including Amazon Linux 2, Windows, and macOS. 58 | 59 | ## AWS Cloud9 60 | 61 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ol5go512n9k6635kwv9v.png) 62 | 63 | AWS Cloud9 is a cloud-based integrated development environment (IDE) that lets you write, run, and debug your code with just a browser. It includes a code editor, debugger, and terminal. Cloud9 comes prepackaged with essential tools for popular programming languages, including JavaScript, Python, PHP, and more, so you don’t need to install files or configure your development machine to start new projects. Since your Cloud9 IDE is cloud-based, you can work on your projects from your office, home, or anywhere using an internet-connected machine. Cloud9 also provides a seamless experience for developing serverless applications enabling you to easily define resources, debug, and switch between local and remote execution of serverless applications. With Cloud9, you can quickly share your development environment with your team, enabling you to pair program and track each other's inputs in real time. 64 | 65 | ## AWS Command Line Interface (AWS CLI) 66 | 67 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ynzxworannwzy4q2mytc.png) 68 | 69 | AWS Command Line Interface (AWS CLI) is an open source tool specifically designed to interact with and control other AWS services from the command line. AWS CLI requires minimal configuration, and developers can run commands with the same functionality as the AWS Management Console. It works with Windows, MacOS and Linux, and it comes preinstalled with the Amazon Linux AMI. 70 | 71 | ## AWS X-Ray 72 | 73 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/vsqx4w0e5a4uplg1z98o.png) 74 | 75 | AWS X-Ray helps developers analyze and debug distributed applications in production or under development, such as those built using a microservices architecture. With X-Ray, you can understand how your application and its underlying services are performing so you can identify and troubleshoot the root cause of performance issues and errors. X-Ray provides an end-to-end view of requests as they travel through your application, and shows a map of your application’s underlying components. You can use X-Ray to analyze both applications in development and in production, from simple three-tier applications to complex microservices applications consisting of thousands of services. 76 | 77 | ## AWS Cloud Development Kit (CDK) 78 | 79 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/8wmkyyv82baofj9daqnx.png) 80 | 81 | AWS Cloud Development Kit (CDK) is an open source software development framework. It defines cloud infrastructure as code through programming languages and AWS CloudFormation deployment. With CDK, developers can interact with their cloud applications. For example, they can list the defined stacks in their apps, move the stacks into CloudFormation templates and deploy them to any public AWS Region. Like other developer services from AWS, there is no additional charge for this tool beyond the associated resources provisioned. 82 | 83 | ## AWS Device Farm 84 | 85 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/go4j30m6rv4stwz0cncj.png) 86 | 87 | AWS Device Farm is a cloud developer tool focused on increasing the quality of applications, time to market and overall customer satisfaction through testing with real mobile devices. With Device Farm, developers upload an application or test scripts to run tests across a large number of real Android and iOS services. Within this tool, developers can also debug or reproduce any customer issues. Developer teams have the option of three pricing models: Pay as you go, which starts at $0.17 per device minute; unlimited testing, which starts at $250.00 per month; and private devices, which starts at $200 per month. 88 | 89 | ## Amazon CodeGuru 90 | 91 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/0un74rpd54r3d31egvf9.png) 92 | 93 | Amazon CodeGuru is a cloud developer tool that recommends ways to enhance code quality and reduce costs. This service relies on machine learning and has two primary components -- Amazon CodeGuru Reviewer and Amazon CodeGuru Profiler. Reviewer finds the major issues and elusive bugs, while Profiler helps optimize performance and cut costs by exposing the priciest lines of code within the app. Priced separately, both features offer a 90-day free trial in supported AWS Regions. After the trial period, pricing is broken down based on number of lines in the code analyzed or the duration of the analysis. 94 | 95 | # Conclusion 96 | 97 | AWS Developer Tools is reliable and secure in many ways and it also helps to integrate an industry. With pay as you go service, the whole AWS is economical and there are no additional charges as the user has to pay only for what they have used. AWS Developer Tools are aimed at speeding up development and making your job as a developer easier. 98 | 99 | Hope this guide gives you an Introduction to Developer Tools with AWS, feel free to connect with me on [LinkedIn.](https://www.linkedin.com/in/adit-modi-2a4362191/) 100 | You can view my badges [here.](https://www.youracclaim.com/users/adit-modi/badges) 101 | If you are interested in learning more about AWS then follow me on [github.](https://github.com/AditModi) 102 | If you liked this content then do clap and share it . Thank You . -------------------------------------------------------------------------------- /Introduction to Game Tech with AWS.md: -------------------------------------------------------------------------------- 1 | You’re imagining future games that delight players, and these games need the infrastructure and solutions to support your development. Bringing your ideas to life requires servers that can scale with tens of millions of players around the world. It requires databases that can process terabytes to petabytes of ever-changing data. It requires analytics solutions that can access that data with millisecond latency. And it requires machine learning that can speed up your processes and even translate into new, immersive gameplay. Players expect games to have regular and compelling updates. More efficient workflows can enable faster time to market when building your next game or migrating existing workloads. 2 | 3 | # WHY AWS GAME TECH? 4 | 5 | Game Tech provides a broad portfolio of managed and core cloud services to help you build faster, operate smarter, and create fun, innovative experiences. No matter your team size, any game can come to life using our range of services, trusted infrastructure, and unmatched pace of innovation. 6 | 7 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/diky79qz6z2zmaybf0yq.png) 8 | 9 | 10 | 11 | *My Background: Cloud Engineer | AWS Community Builder | AWS Educate Cloud Ambassador | 4x AWS Certified | 3x OCI Certified | 3x Azure Certified.* 12 | 13 | The Introduction to AWS is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 14 | 15 | 16 | # Build your game in the cloud 17 | 18 | Reduce downtime and save costs 19 | Improve gameplay and minimize latency with backend infrastructure that’s closer to your players. Decrease operational costs during low-demand periods using serverless architectures and servers with automatic scaling. With AWS’s infrastructure, studios can pay only for the resources they use instead of investing in servers upfront. 20 | 21 | # Increase productivity and efficiency 22 | 23 | Deploy new game features faster, expand capacity to meet player demand, and reduce fraud and cheating. Reduce the amount of building and testing needed to launch your game using automation and managed services that are designed for game workloads. With over 1 million active customers across 190 countries, 24 regions, 77 Availability Zones, studios can have new IT resources available in just a few clicks, increasing agility. 24 | 25 | # Extend player lifetime value (LTV) 26 | 27 | Extend the life of your game and keep innovating with services that help you understand your players and keep them engaged longer. With 175+ services supporting virtually any cloud workload, developers can de-provision servers as needed enabling them to experiment often and fail fast if a game idea doesn’t work. 28 | 29 | # Enable innovation with a trusted partner 30 | 31 | Build highly available multiplayer games with global reach, automatic scaling, and intelligent matchmaking. We provide the core staples of technology infrastructure, so studios can focus on developing the engagement with players rather than on infrastructure. 32 | 33 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/0atfp6m8jcf8cqyqzixc.png) 34 | 35 | # Amazon GameLift 36 | 37 | Amazon GameLift is a managed service for deploying, operating, and scaling dedicated game servers for session-based multiplayer games. Amazon GameLift makes it easy to manage server infrastructure, scale capacity to lower latency and cost, match players into available game sessions, and defend from distributed denial-of-service (DDoS) attacks. You pay for the compute resources and bandwidth your games actually use, without monthly or annual contracts. 38 | 39 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/888c52hu0lzq2adeuvn2.png) 40 | 41 | ## Why GameLift ? 42 | 43 | Here are some of the benefits of using Amazon GameLift: 44 | 45 | Bring your own fully custom multiplayer game servers or use ready-to-go Realtime Servers that require minimal configuration and little or no backend experience. 46 | 47 | Provide low-latency player experience to support fast-action game play. 48 | 49 | Enhance your matchmaking services with intelligent queuing, game session placement, and match backfill. 50 | 51 | Reduce engineering and operational effort to deploy and operate game servers globally. 52 | 53 | Get started fast and pay as you go, with no upfront costs and no long-term commitments. 54 | 55 | Reduce costs by up to 90% with Spot Instances. 56 | 57 | Rely on Amazon Web Services (AWS), including Amazon Elastic Compute Cloud (Amazon EC2) for web-scale cloud computing resources and auto-scaling to manage your hosting capacity. 58 | 59 | 60 | ### GameLift offers a range of solutions for game developers: 61 | 62 | * GameLift hosting for custom-built game servers. 63 | 64 | * GameLift hosting with Realtime Servers 65 | 66 | * GameLift FleetIQ game hosting optimizations for use with Amazon EC2 67 | 68 | ## GameLift hosting 69 | 70 | Amazon GameLift offers a fully managed service for deploying, operating, and scaling session-based, multiplayer game servers. GameLift replaces the work required to host your own custom game servers, including buying and setting up hardware, and managing ongoing activity, security, storage, and performance tracking. Auto-scaling capabilities provide additional protection from having to pay for more resources than you need, while making sure you always have games available for new players to join with minimal waiting. 71 | 72 | To learn more about how the GameLift hosting solution works, see [How GameLift works](https://docs.aws.amazon.com/gamelift/latest/developerguide/gamelift-howitworks.html). 73 | 74 | ## GameLift hosting with Realtime Servers 75 | 76 | Use Realtime Servers to stand up games that don't need custom-built game servers. This lightweight server solution provides ready-to-go game servers that can be configured to fit your game. You can deploy game servers with anything from minimal configuration settings to custom logic that is specific to your game and players. 77 | 78 | To learn more about how GameLift hosting with Realtime Servers works, see [How Realtime Servers Work](https://docs.aws.amazon.com/gamelift/latest/developerguide/realtime-howitworks.html). 79 | 80 | ## GameLift FleetIQ 81 | 82 | GameLift FleetIQ optimizes the use of low-cost Spot Instances for cloud-based game hosting. With this feature, you can work directly with your hosting resources in Amazon EC2 and Auto Scaling and take advantage of GameLift optimizations to deliver inexpensive, resilient game hosting for your players. This solution is designed for game developers who need more flexibility than is offered in the fully managed GameLift solutions. 83 | 84 | To learn more about how GameLift FleetIQ works with Amazon EC2 and Auto Scaling for game hosting, see the [GameLift FleetIQ Guide](https://docs.aws.amazon.com/gamelift/latest/fleetiqguide/gsg-intro.html). 85 | 86 | # Amazon Lumberyard 87 | 88 | Amazon Lumberyard is a free, cross-platform, 3D game engine for you to create the highest-quality games, connect your games to the vast compute and storage of the AWS Cloud, and engage fans on Twitch. By starting game projects with Lumberyard, you can spend more of your time creating great gameplay and building communities of fans, and less time on the undifferentiated heavy lifting of building a game engine and managing server infrastructure. 89 | 90 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ntld5pbacqsdgoe15h76.png) 91 | 92 | ## What is Lumberyard? 93 | 94 | Amazon Lumberyard is a free, cross-platform, 3D game engine that allows you to create high-quality games, connect your games to the compute and storage of the AWS Cloud, and engage fans on Twitch. With Lumberyard, you can spend more time creating great gameplay and building communities of fans, and less time on the heavy lifting of building a game engine and managing servers. 95 | 96 | Lumberyard offers everything a professional game developer can expect, such as a full-featured editor, native code performance, and stunning visuals. It also includes hundreds of other ready-to-use features like networking, cinematics, the Script Canvas editor, the Animation Editor, audio tools, and more. 97 | 98 | ## A world-class engine 99 | 100 | At its core, Lumberyard is a high-performance real-time 3D engine that produces incredible visual fidelity. Lumberyard includes all the capabilities that professional designers, artists, and developers expect, with familiar user experience patterns that enable fast adoption and development. Its robust toolset enables rapid iteration to the highest quality. Built on a modular architecture and extensible through the Gems framework, Lumberyard makes it easy to add new features, APIs, and assets. 101 | 102 | ## Deeply integrated with Amazon Web Services 103 | 104 | Lumberyard’s online capabilities, backed by Amazon Web Services, offer staggering possibilities to developers. Common connected elements like dedicated servers, dynamic content, online economies, and real-time stats are easily implemented and scaled, so you can focus on the creative aspects of your project. With Lumberyard’s crossplay capabilities and Twitch integration, you can find new and novel ways to engage people socially. The limitless potential of AWS can deliver experiences that reach far beyond the capabilities of any single device. 105 | 106 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/n4jjbiguhokgxrfnpug5.png) 107 | 108 | ## AWS integrations include: 109 | 110 | ### Amazon GameLift 111 | 112 | Amazon GameLift is an AWS service for deploying, operating, and scaling session-based multiplayer games. You can scale high-performance game servers up and down to meet player demand without additional engineering effort. 113 | 114 | For more information, see the [Amazon GameLift Developer Guide](https://docs.aws.amazon.com/gamelift/latest/developerguide/). 115 | 116 | ### Cloud Canvas 117 | 118 | Cloud Canvas is Lumberyard's technology for connecting your game to Amazon Web Services. With Cloud Canvas, you can use AWS to implement cloud-hosted features and create asynchronous multiplayer games. Using AWS means you no longer have to acquire, configure, or operate host servers to implement connected gameplay. 119 | 120 | You can build live, online game features, such as a community news feed, daily gifts, or in-game notifications, in minutes with Lumberyard's Cloud Canvas tool. Using cloud gems, you can build gameplay that connects to AWS services, such as Amazon DynamoDB, AWS Lambda, and Amazon S3. 121 | 122 | For more information, see [Implementing Connected Features with Cloud Canvas](https://docs.aws.amazon.com/lumberyard/latest/userguide/cloud-canvas-intro.html). 123 | 124 | ### AWS SDK for C++ 125 | 126 | The AWS SDK for C++ provides C++ API operations for numerous AWS services including Amazon S3, Amazon EC2, Amazon DynamoDB, and more, with support for all major native platforms. You can use the SDK to integrate AWS components into your game. 127 | 128 | For more information, see the [AWS SDK for C++](https://aws.amazon.com/sdk-for-cpp/). 129 | 130 | ### Integrated with Twitch 131 | Lumberyard is integrated with Twitch so that you can build games that engage with more than 1.7 million monthly broadcasters and more than 100 million monthly viewers on Twitch. 132 | 133 | ### Twitch ChatPlay 134 | 135 | The Twitch ChatPlay feature within Lumberyard helps you build gameplay that interacts in real time with Twitch viewers. For example, you can build a game where viewers can vote on game outcomes, gift power-ups to their favorite players, or change the level based on the number of viewers watching the player. 136 | 137 | For more information, see [Twitch ChatPlay System](https://docs.aws.amazon.com/lumberyard/latest/userguide/chatplay-intro.html). 138 | 139 | ### Free with Source 140 | 141 | Lumberyard is free, including source code. You can customize Lumberyard for your team and vision for your project today, and for future projects. There are no seat fees, subscription fees, or requirements to share revenue. Only pay for the AWS services that you choose to use. 142 | 143 | # Conclusion 144 | 145 | traditional streaming approaches for 3D interactive content and applications like online gaming have difficulty reaching this level of concurrency. The cost is prohibitive, and even if budgets were limitless, the cloud GPU hardware is just not available to scale. To ensure the future of our cloud gaming for changing experiences and immersive environments we must face the realities of current approaches head-on and redefine scale to incorporate the concepts of concurrency, reach and new experiences. Driving towards a future where the possibilities are limitless, leading to games being built in a cloud-first approach. 146 | 147 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/t27cf4cyf880ww1r29dx.png) 148 | 149 | 150 | Hope this guide helps you with the Introduction to GameTech with AWS, feel free to connect with me on [LinkedIn.](https://www.linkedin.com/in/adit-modi-2a4362191/) 151 | You can view my badges [here.](https://www.youracclaim.com/users/adit-modi/badges) 152 | If you are interested in learning more about AWS Services then follow me on [github.](https://github.com/AditModi) 153 | If you liked this content then do clap and share it . Thank You . -------------------------------------------------------------------------------- /Introduction to Machine Learning with AWS - Part 1.md: -------------------------------------------------------------------------------- 1 | 2 | AWS offers the broadest and deepest set of machine learning services and supporting cloud infrastructure, putting machine learning in the hands of every developer, data scientist and expert practitioner. 3 | 4 | In this blog post, we will discuss some of the most important AWS machine learning services that help you make accurate predictions, get deeper insights from your data, reduce operational overhead, and improve customer experience. AWS helps you at every stage of your ML adoption journey with the most comprehensive set of artificial intelligence (AI) and ML services, infrastructure, and implementation resources. 5 | 6 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/dovlzi24raggblu8n3ld.png) 7 | 8 | > **The Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 9 | 10 | # AWS Machine Learning Services 11 | 12 | * AWS helps streamline self-service processes and reduce operational costs through chatbots and virtual assistants. 13 | * AWS compiles data from siloed and unstructured sources across your organization to drive business productivity and customer satisfaction. 14 | * AWS helps drive customer engagement and conversion with websites tailored to individual visitors—and see your conversion rates soar. 15 | * Using AWS, customers can instantly extract text and data from virtually any document, such as loan applications and medical forms, without manual effort. 16 | 17 | # SageMaker 18 | 19 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/c7tgpvim9ms3gt12tjyo.png) 20 | 21 | * SageMaker is a fully-managed platform that enables developers and data scientists to quickly and easily build, train, and deploy machine learning models at any scale. SageMaker removes all the barriers that typically slow down developers who want to use machine learning. 22 | 23 | * Machine learning often feels a lot harder than it should be to most developers because the process to build and train models, and then deploy them into production is too complicated and too slow. First, you need to collect and prepare your training data to discover which elements of your data set are important. 24 | 25 | * Then, you need to select which algorithm and framework you’ll use. After deciding on your approach, you need to teach the model how to make predictions by training, which requires a lot of compute. Then, you need to tune the model so it delivers the best possible predictions, which is often a tedious and manual effort. 26 | 27 | * After you’ve developed a fully trained model, you need to integrate the model with your application and deploy this application on infrastructure that will scale. All of this takes a lot of specialized expertise, access to large amounts of compute and storage, and a lot of time to experiment and optimize every part of the process. In the end, it's not a surprise that the whole thing feels out of reach for most developers. 28 | 29 | * SageMaker removes the complexity that holds back developer success with each of these steps. SageMaker includes modules that can be used together or independently to build, train, and deploy your machine learning models. 30 | 31 | # SageMaker Ground Truth 32 | 33 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/5u7ra2g1j7kk7xpiawwd.png) 34 | 35 | * SageMaker Ground Truth helps you build highly accurate training datasets for machine learning quickly. SageMaker Ground Truth offers easy access to public and private human labelers and provides them with built-in workflows and interfaces for common labeling tasks. 36 | 37 | * Additionally, SageMaker Ground Truth can lower your labeling costs by up to 70% using automatic labeling, which works by training Ground Truth from data labeled by humans so that the service learns to label data independently. 38 | 39 | * Successful machine learning models are built on the shoulders of large volumes of high-quality training data. But, the process to create the training data necessary to build these models is often expensive, complicated, and time-consuming. The majority of models created today require a human to manually label data in a way that allows the model to learn how to make correct decisions. 40 | 41 | * For example, building a computer vision system that is reliable enough to identify objects - such as traffic lights, stop signs, and pedestrians - requires thousands of hours of video recordings that consist of hundreds of millions of video frames. Each one of these frames needs all of the important elements like the road, other cars, and signage to be labeled by a human before any work can begin on the model you want to develop. 42 | 43 | * Amazon SageMaker Ground Truth significantly reduces the time and effort required to create datasets for training to reduce costs. These savings are achieved by using machine learning to automatically label data. The model is able to get progressively better over time by continuously learning from labels created by human labelers. 44 | 45 | * Where the labeling model has high confidence in its results based on what it has learned so far, it will automatically apply labels to the raw data. Where the labeling model has lower confidence in its results, it will pass the data to humans to do the labeling. 46 | 47 | * The human-generated labels are provided back to the labeling model for it to learn from and improve. Over time, SageMaker Ground Truth can label more and more data automatically and substantially speed up the creation of training datasets. 48 | 49 | # Amazon Comprehend 50 | 51 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/uspyi1v6h346errzrck7.png) 52 | 53 | * Amazon Comprehend is a natural language processing (NLP) service that uses machine learning to find insights and relationships in text. No machine learning experience required. 54 | 55 | * There is a treasure trove of potential sitting in your unstructured data. Customer emails, support tickets, product reviews, social media, even advertising copy represents insights into customer sentiment that can be put to work for your business. The question is how to get at it? As it turns out, Machine learning is particularly good at accurately identifying specific items of interest inside vast swathes of text (such as finding company names in analyst reports), and can learn the sentiment hidden inside language (identifying negative reviews, or positive customer interactions with customer service agents), at almost limitless scale. 56 | 57 | * Amazon Comprehend uses machine learning to help you uncover the insights and relationships in your unstructured data. The service identifies the language of the text; extracts key phrases, places, people, brands, or events; understands how positive or negative the text is; analyzes text using tokenization and parts of speech; and automatically organizes a collection of text files by topic. 58 | 59 | * You can also use AutoML capabilities in Amazon Comprehend to build a custom set of entities or text classification models that are tailored uniquely to your organization’s needs. 60 | 61 | * For extracting complex medical information from unstructured text, you can use Amazon Comprehend Medical. The service can identify medical information, such as medical conditions, medications, dosages, strengths, and frequencies from a variety of sources like doctor’s notes, clinical trial reports, and patient health records. 62 | 63 | * Amazon Comprehend Medical also identifies the relationship among the extracted medication and test, treatment and procedure information for easier analysis. For example, the service identifies a particular dosage, strength, and frequency related to a specific medication from unstructured clinical notes. 64 | 65 | # Amazon Lex 66 | 67 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/k3x5ye021m3wzo31v9lt.png) 68 | 69 | * Amazon Lex is a service for building conversational interfaces into any application using voice and text. Lex provides the advanced deep learning functionalities of automatic speech recognition (ASR) for converting speech to text, and natural language understanding (NLU) to recognize the intent of the text, to enable you to build applications with highly engaging user experiences and lifelike conversational interactions. 70 | 71 | * With Amazon Lex, the same deep learning technologies that power Amazon Alexa are now available to any developer, enabling you to quickly and easily build sophisticated, natural language, conversational bots (“chatbots”). 72 | 73 | * Speech recognition and natural language understanding are some of the most challenging problems to solve in computer science, requiring sophisticated deep learning algorithms to be trained on massive amounts of data and infrastructure. 74 | 75 | * Amazon Lex democratizes these deep learning technologies by putting the power of Alexa within reach of all developers. Harnessing these technologies, Amazon Lex enables you to define entirely new categories of products made possible through conversational interfaces. 76 | 77 | # Amazon Polly 78 | 79 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/x5d4e97r0unoj9mvppl1.png) 80 | 81 | * Amazon Polly is a service that turns text into lifelike speech. Polly lets you create applications that talk, enabling you to build entirely new categories of speech-enabled products. 82 | 83 | * Polly is an Amazon artificial intelligence (AI) service that uses advanced deep learning technologies to synthesize speech that sounds like a human voice. Polly includes 47 lifelike voices spread across 24 languages, so you can select the ideal voice and build speech-enabled applications that work in many different countries. 84 | 85 | * Amazon Polly delivers the consistently fast response times required to support real-time, interactive dialog. You can cache and save Polly’s speech audio to replay offline or redistribute. And Polly is easy to use. 86 | 87 | * You simply send the text you want converted into speech to the Polly API, and Polly immediately returns the audio stream to your application so your application can play it directly or store it in a standard audio file format, such as MP3. 88 | 89 | * With Polly, you only pay for the number of characters you convert to speech, and you can save and replay Polly’s generated speech. Polly’s low cost per character converted, and lack of restrictions on storage and reuse of voice output, make it a cost-effective way to enable Text-to-Speech everywhere. 90 | 91 | # Amazon Rekognition 92 | 93 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ppjzk80dgkiq0095itw2.png) 94 | 95 | * Amazon Rekognition is a service that makes it easy to add image analysis to your applications. With Rekognition, you can detect objects, scenes, and faces in images. You can also search and compare faces. The Amazon Rekognition API enables you to quickly add sophisticated deep-learning-based visual search and image classification to your applications. 96 | 97 | * Amazon Rekognition is based on the same proven, highly scalable, deep learning technology developed by Amazon’s computer vision scientists to analyze billions of images daily for Prime Photos. Amazon Rekognition uses deep neural network models to detect and label thousands of objects and scenes in your images, and we are continually adding new labels and facial recognition features to the service. 98 | 99 | * The Amazon Rekognition API lets you easily build powerful visual search and discovery into your applications. With Amazon Rekognition, you only pay for the images you analyze and the face metadata you store. There are no minimum fees, and there are no upfront commitments. 100 | 101 | # Amazon Translate 102 | 103 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/0shi3f5g3p2anppo7mkf.png) 104 | 105 | * Amazon Translate is a neural machine translation service that delivers fast, high-quality, and affordable language translation. Neural machine translation is a form of language translation automation that uses deep learning models to deliver more accurate and more natural sounding translation than traditional statistical and rule-based translation algorithms. 106 | 107 | * Amazon Translate allows you to localize content - such as websites and applications - for international users, and to easily translate large volumes of text efficiently. 108 | 109 | # Amazon Transcribe 110 | 111 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/s4rwezftk5qttgigy8mq.png) 112 | 113 | * Amazon Transcribe is an automatic speech recognition (ASR) service that makes it easy for developers to add speech-to-text capability to their applications. Using the Amazon Transcribe API, you can analyze audio files stored in Amazon S3 and have the service return a text file of the transcribed speech. You can also send a live audio stream to Amazon Transcribe and receive a stream of transcripts in real time. 114 | 115 | * Amazon Transcribe can be used for lots of common applications, including the transcription of customer service calls and generating subtitles on audio and video content. The service can transcribe audio files stored in common formats, like WAV and MP3, with time stamps for every word so that you can easily locate the audio in the original source by searching for the text. Amazon Transcribe is continually learning and improving to keep pace with the evolution of language. 116 | 117 | 118 | 119 | # Amazon Forecast 120 | 121 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/bcwse141z84opqp5x9gw.png) 122 | 123 | * Amazon Forecast is a fully managed service that uses machine learning to deliver highly accurate forecasts. 124 | 125 | * Companies today use everything from simple spreadsheets to complex financial planning software to attempt to accurately forecast future business outcomes such as product demand, resource needs, or financial performance. 126 | 127 | * These tools build forecasts by looking at a historical series of data, which is called time series data. For example, such tools may try to predict the future sales of a raincoat by looking only at its previous sales data with the underlying assumption that the future is determined by the past. 128 | 129 | * This approach can struggle to produce accurate forecasts for large sets of data that have irregular trends. Also, it fails to easily combine data series that change over time (such as price, discounts, web traffic, and number of employees) with relevant independent variables like product features and store locations. 130 | 131 | * Based on the same technology used at Amazon.com, Amazon Forecast uses machine learning to combine time series data with additional variables to build forecasts. Amazon Forecast requires no machine learning experience to get started. You only need to provide historical data, plus any additional data that you believe may impact your forecasts. 132 | 133 | * For example, the demand for a particular color of a shirt may change with the seasons and store location. This complex relationship is hard to determine on its own, but machine learning is ideally suited to recognize it. 134 | 135 | * Once you provide your data, Amazon Forecast will automatically examine it, identify what is meaningful, and produce a forecasting model capable of making predictions that are up to 50% more accurate than looking at time series data alone. 136 | 137 | * Amazon Forecast is a fully managed service, so there are no servers to provision, and no machine learning models to build, train, or deploy. You pay only for what you use, and there are no minimum fees and no upfront commitments. 138 | 139 | # Amazon Textract 140 | 141 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/h6diu7xchy6pwrge3nux.png) 142 | 143 | * Amazon Textract is a service that automatically extracts text and data from scanned documents. Amazon Textract goes beyond simple optical character recognition (OCR) to also identify the contents of fields in forms and information stored in tables. 144 | 145 | * Many companies today extract data from documents and forms through manual data entry that’s slow and expensive or through simple optical character recognition (OCR) software that is difficult to customize. 146 | 147 | * Rules and workflows for each document and form often need to be hard-coded and updated with each change to the form or when dealing with multiple forms. If the form deviates from the rules, the output is often scrambled and unusable. 148 | 149 | * Amazon Textract overcomes these challenges by using machine learning to instantly “read” virtually any type of document to accurately extract text and data without the need for any manual effort or custom code. 150 | 151 | * With Textract you can quickly automate document workflows, enabling you to process millions of document pages in hours. Once the information is captured, you can take action on it within your business applications to initiate next steps for a loan application or medical claims processing. 152 | 153 | * Additionally, you can create smart search indexes, build automated approval workflows, and better maintain compliance with document archival rules by flagging data that may require redaction. 154 | 155 | # Amazon Personalize 156 | 157 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/tkkn1rtao4y0uxu3kvmx.png) 158 | 159 | * Amazon Personalize is a machine learning service that makes it easy for developers to create individualized recommendations for customers using their applications. 160 | 161 | * Machine learning is being increasingly used to improve customer engagement by powering personalized product and content recommendations, tailored search results, and targeted marketing promotions. 162 | 163 | * However, developing the machine-learning capabilities necessary to produce these sophisticated recommendation systems has been beyond the reach of most organizations today due to the complexity of developing machine learning functionality. 164 | 165 | * Amazon Personalize allows developers with no prior machine learning experience to easily build sophisticated personalization capabilities into their applications, using machine learning technology perfected from years of use on Amazon.com. 166 | 167 | * With Amazon Personalize, you provide an activity stream from your application – page views, signups, purchases, and so forth – as well as an inventory of the items you want to recommend, such as articles, products, videos, or music. 168 | 169 | * You can also choose to provide Amazon Personalize with additional demographic information from your users such as age, or geographic location. Amazon Personalize will process and examine the data, identify what is meaningful, select the right algorithms, and train and optimize a personalization model that is customized for your data. 170 | 171 | * All data analyzed by Amazon Personalize is kept private and secure, and only used for your customized recommendations. You can start serving your personalized predictions via a simple API call from inside the virtual private cloud that the service maintains. You pay only for what you use, and there are no minimum fees and no upfront commitments. 172 | 173 | * Amazon Personalize is like having your own Amazon.com machine learning personalization team at your disposal, 24 hours a day. 174 | 175 | --- 176 | 177 | Hope this guide helps you with the Introduction to Machine Learning with AWS - Part-1. In the Next Blog Post, we will discuss more about different Machine learning Services that are available with AWS. 178 | 179 | Let me know your thoughts in the comment section 👇 180 | And if you haven't yet, make sure to follow me on below handles: 181 | 182 | 👋 **connect with me on [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/)** 183 | 🤓 **connect with me on [Twitter](https://twitter.com/adi_12_modi)** 184 | 🐱‍💻 **follow me on [github](https://github.com/AditModi)** 185 | ✍️ **Do Checkout [my blogs](https://aditmodi.hashnode.dev)** 186 | 187 | Like, share and follow me 🚀 for more content. 188 | 189 | {% user aditmodi %} -------------------------------------------------------------------------------- /Introduction to Machine Learning with AWS - Part 2.md: -------------------------------------------------------------------------------- 1 | Organizations across the globe face considerable pressure to innovate digitally to remain competitive. One of the key areas that many organizations have identified as a source of opportunity to improve their pace of innovation is their software development and operations, or Developing Machine Learning Applications. 2 | 3 | * In this blog post, we will discuss some of the most important AWS machine learning services that helps customers solve real-world business problems in any industry. Use ready-made, purpose-built AI services or your own models with AWS ML services. This services helps you address common business problems to improve customer experience, optimize business processes, and accelerate innovation. 4 | 5 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wcgozxydp1vrowgjlfqg.png) 6 | 7 | > **The Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 8 | 9 | # AWS Machine Learning Services 10 | 11 | * AWS helps customers use ML to accurately forecast sales, financial, and demand data, and automatically identify anomalies and their root cause. 12 | * AWS helps detect and prevent online fraud, such as fake accounts and payment fraud in real-time using ML. 13 | * AWS helps build fast and innovate more with Next Gen DevOps. 14 | 15 | 16 | # Amazon Augmented AI 17 | 18 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/r6kne22qsgtl9ld0exbw.png) 19 | 20 | * Amazon Augmented AI (Amazon A2I) is a machine learning service which makes it easy to build the workflows required for human review. 21 | * Amazon A2I brings human review to all developers, removing the undifferentiated heavy lifting associated with building human review systems or managing large numbers of human reviewers whether it runs on AWS or not. 22 | 23 | # Amazon CodeGuru 24 | 25 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ji9hk9e33r7bptapw56o.png) 26 | 27 | * Amazon CodeGuru is a developer tool that provides intelligent recommendations to improve code quality and identify an application’s most expensive lines of code. 28 | * Integrate CodeGuru into your existing software development workflow to automate code reviews during application development and continuously monitor application's performance in production and provide recommendations and visual clues on how to improve code quality, application performance, and reduce overall cost. 29 | 30 | * CodeGuru Reviewer uses machine learning and automated reasoning to identify critical issues, security vulnerabilities, and hard-to-find bugs during application development and provides recommendations to improve code quality. 31 | 32 | * CodeGuru Profiler helps developers find an application’s most expensive lines of code by helping them understand the runtime behavior of their applications, identify and remove code inefficiencies, improve performance, and significantly decrease compute costs. 33 | 34 | # Amazon DevOps Guru 35 | 36 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/katzocvngg6arrg9e0g6.png) 37 | 38 | * Amazon DevOps Guru is a Machine Learning (ML) powered service that makes it easy to improve an application’s operational performance and availability. DevOps Guru detects behaviors that deviate from normal operating patterns so you can identify operational issues long before they impact your customers. 39 | 40 | * DevOps Guru uses machine learning models informed by years of Amazon.com and AWS operational excellence to identify anomalous application behavior (e.g. increased latency, error rates, resource constraints, etc.) and surface critical issues that could cause potential outages or service disruptions. 41 | * When DevOps Guru identifies a critical issue, it automatically sends an alert and provides a summary of related anomalies, the likely root cause, and context about when and where the issue occurred. When possible DevOps Guru, also provides recommendations on how to remediate the issue. 42 | 43 | * DevOps Guru automatically ingests operational data from your AWS applications and provides a single dashboard to visualize issues in your operational data. 44 | * You can get started with DevOps Guru by selecting coverage from your CloudFormation stacks or your AWS account to improve application availability and reliability with no manual setup or machine learning expertise. 45 | 46 | # Amazon Elastic Inference 47 | 48 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ui0eud2581zszgk5ctpk.png) 49 | 50 | * Amazon Elastic Inference allows you to attach low-cost GPU-powered acceleration to Amazon EC2 and Amazon SageMaker instances to reduce the cost of running deep learning inference by up to 75%. Amazon Elastic Inference supports TensorFlow, Apache MXNet, PyTorch, and ONNX models. 51 | 52 | * In most deep learning applications, making predictions using a trained model—a process called inference—can drive as much as 90% of the compute costs of the application due to two factors. First, standalone GPU instances are designed for model training and are typically oversized for inference. 53 | * While training jobs batch process hundreds of data samples in parallel, most inference happens on a single input in real time that consumes only a small amount of GPU compute. 54 | * Even at peak load, a GPU's compute capacity may not be fully utilized, which is wasteful and costly. Second, different models need different amounts of GPU, CPU, and memory resources. 55 | * Selecting a GPU instance type that is big enough to satisfy the requirements of the least used resource often results in under-utilization of the other resources and high costs. 56 | 57 | * Amazon Elastic Inference solves these problems by allowing you to attach just the right amount of GPU-powered inference acceleration to any EC2 or SageMaker instance type with no code changes. 58 | * With Amazon Elastic Inference, you can now choose the instance type that is best suited to the overall CPU and memory needs of your application, and then separately configure the amount of inference acceleration that you need to use resources efficiently and to reduce the cost of running inference. 59 | 60 | # Amazon Fraud Detector 61 | 62 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/rwfikjpmlv5xk2xl5nb9.png) 63 | 64 | * Amazon Fraud Detector is a fully managed service that uses machine learning (ML) and more than 20 years of fraud detection expertise from Amazon, to identify potentially fraudulent activity so customers can catch more online fraud faster. 65 | * Amazon Fraud Detector automates the time consuming and expensive steps to build, train, and deploy an ML model for fraud detection, making it easier for customers to leverage the technology. 66 | * Amazon Fraud Detector customizes each model it creates to a customer’s own dataset, making the accuracy of models higher than current one-size fits all ML solutions. And, because you pay only for what you use, you avoid large upfront expenses. 67 | 68 | # Amazon HealthLake 69 | 70 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/15zrcw18500sx16mtcv9.png) 71 | 72 | * Amazon HealthLake is a HIPAA-eligible service that healthcare providers, health insurance companies, and pharmaceutical companies can use to store, transform, query, and analyze large-scale health data. 73 | 74 | * Health data is frequently incomplete and inconsistent. It's also often unstructured, with information contained in clinical notes, lab reports, insurance claims, medical images, recorded conversations, and time-series data (for example, heart ECG or brain EEG traces). 75 | 76 | * Healthcare providers can use HealthLake to store, transform, query, and analyze data in the AWS Cloud. Using the HealthLake integrated medical natural language processing (NLP) capabilities, you can analyze unstructured clinical text from diverse sources. 77 | * HealthLake transforms unstructured data using natural language processing models, and provides powerful query and search capabilities. You can use HealthLake to organize, index, and structure patient information in a secure, compliant, and auditable manner. 78 | 79 | 80 | 81 | # Amazon Kendra 82 | 83 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/f5qh7i3vro4diea5hmox.png) 84 | 85 | * Amazon Kendra is an intelligent search service powered by machine learning. Kendra reimagines enterprise search for your websites and applications so your employees and customers can easily find the content they are looking for, even when it’s scattered across multiple locations and content repositories within your organization. 86 | 87 | * Using Amazon Kendra, you can stop searching through troves of unstructured data and discover the right answers to your questions, when you need them. Amazon Kendra is a fully managed service, so there are no servers to provision, and no machine learning models to build, train, or deploy. 88 | 89 | # Amazon Lookout for Equipment 90 | 91 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/yuuh4t0g5qe3mqb9vyq1.png) 92 | 93 | * Amazon Lookout for Equipment analyzes the data from the sensors on your equipment (e.g. pressure in a generator, flow rate of a compressor, revolutions per minute of fans), to automatically train a machine learning model based on just your data, for your equipment – with no ML expertise required. 94 | * Lookout for Equipment uses your unique ML model to analyze incoming sensor data in real-time and accurately identify early warning signs that could lead to machine failures. This means you can detect equipment abnormalities with speed and precision, quickly diagnose issues, take action to reduce expensive downtime, and reduce false alerts. 95 | 96 | # Amazon Lookout for Metrics 97 | 98 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/odf69rbolwvhha7mxq8c.png) 99 | 100 | * Amazon Lookout for Metrics uses machine learning (ML) to automatically detect and diagnose anomalies (i.e. outliers from the norm) in business and operational data, such as a sudden dip in sales revenue or customer acquisition rates. 101 | * In a couple of clicks, you can connect Amazon Lookout for Metrics to popular data stores like Amazon S3, Amazon Redshift, and Amazon Relational Database Service (RDS), as well as third-party SaaS applications, such as Salesforce, Servicenow, Zendesk, and Marketo, and start monitoring metrics that are important to your business. 102 | * Amazon Lookout for Metrics automatically inspects and prepares the data from these sources to detect anomalies with greater speed and accuracy than traditional methods used for anomaly detection. You can also provide feedback on detected anomalies to tune the results and improve accuracy over time. 103 | * Amazon Lookout for Metrics makes it easy to diagnose detected anomalies by grouping together anomalies that are related to the same event and sending an alert that includes a summary of the potential root cause. It also ranks anomalies in order of severity so that you can prioritize your attention to what matters the most to your business. 104 | 105 | # Amazon Lookout for Vision 106 | 107 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/9y6mlx1qnz6fik9zs6e4.png) 108 | 109 | * Amazon Lookout for Vision is a machine learning (ML) service that spots defects and anomalies in visual representations using computer vision (CV). With Amazon Lookout for Vision, manufacturing companies can increase quality and reduce operational costs by quickly identifying differences in images of objects at scale. 110 | * For example, Amazon Lookout for Vision can be used to identify missing components in products, damage to vehicles or structures, irregularities in production lines, miniscule defects in silicon wafers, and other similar problems. 111 | * Amazon Lookout for Vision uses ML to see and understand images from any camera as a person would, but with an even higher degree of accuracy and at a much larger scale. 112 | * Amazon Lookout for Vision allows customers to eliminate the need for costly and inconsistent manual inspection, while improving quality control, defect and damage assessment, and compliance. 113 | * In minutes, you can begin using Amazon Lookout for Vision to automate inspection of images and objects–with no machine learning expertise required. 114 | 115 | # Amazon Monitron 116 | 117 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/sks28htpz6nhwvks2f6m.png) 118 | 119 | * Amazon Monitron is an end-to-end system that uses machine learning (ML) to detect abnormal behavior in industrial machinery, enabling you to implement predictive maintenance and reduce unplanned downtime. 120 | 121 | * Installing sensors and the necessary infrastructure for data connectivity, storage, analytics, and alerting are foundational elements for enabling predictive maintenance. However, in order to make it work, companies have historically needed skilled technicians and data scientists to piece together a complex solution from scratch. 122 | * This included identifying and procuring the right type of sensors for their use cases and connecting them together with an IoT gateway (a device that aggregates and transmits data). As a result, few companies have been able to successfully implement predictive maintenance. 123 | 124 | * Amazon Monitron includes sensors to capture vibration and temperature data from equipment, a gateway device to securely transfer data to AWS, the Amazon Monitron service that analyzes the data for abnormal machine patterns using machine learning, and a companion mobile app to set up the devices and receive reports on operating behavior and alerts to potential failures in your machinery. 125 | * You can start monitoring equipment health in minutes without any development work or ML experience required, and enable predictive maintenance with the same technology used to monitor equipment in Amazon Fulfillment Centers. 126 | 127 | --- 128 | 129 | Hope this guide helps you with the Introduction to Machine Learning with AWS - Part-2. In the Next Blog Post, we will discuss more about remaining Machine learning Services that are available with AWS. 130 | 131 | Let me know your thoughts in the comment section 👇 132 | And if you haven't yet, make sure to follow me on below handles: 133 | 134 | 👋 **connect with me on [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/)** 135 | 🤓 **connect with me on [Twitter](https://twitter.com/adi_12_modi)** 136 | 🐱‍💻 **follow me on [github](https://github.com/AditModi)** 137 | ✍️ **Do Checkout [my blogs](https://aditmodi.hashnode.dev)** 138 | 139 | Like, share and follow me 🚀 for more content. 140 | 141 | {% user aditmodi %} 142 | -------------------------------------------------------------------------------- /Introduction to Machine Learning with AWS - Part 3.md: -------------------------------------------------------------------------------- 1 | * Machine learning (ML) has become a core technology ingredient in a wide range of use cases from natural language processing and computer vision to fraud detection, demand forecasting, product recommendations, preventive maintenance, and document processing. 2 | 3 | * Harnessing the benefits of machine learning at scale requires standardizing on a modern ML development process across your business. 4 | 5 | * In this blog post, we will discuss some of the most important AWS machine learning services that helps customers Modernize their ML development process which can accelerate their pace of innovation by providing scalable infrastructure, integrated tooling, healthy practices for responsible use of ML, a choice of tools accessible to developers and data scientists of all ML skill levels, and efficient resource management to keep costs low. 6 | 7 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/quqw0zdfmro1917tc4bi.png) 8 | 9 | > **The Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 10 | 11 | # AWS Machine Learning Services 12 | 13 | * AWS infuses intelligence into your contact center and reduce costs with automated ML. 14 | * AWS helps customers apply ML to videos, webpages, APIs, and more to enhance discovery, localization, compliance, and monetization. 15 | * AWS helps accelerate machine learning innovation at scale while reducing costs. 16 | 17 | # Apache MXNet on AWS 18 | 19 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/myr27snolgtotrzwms5u.png) 20 | 21 | * Apache MXNet on AWS is a fast and scalable training and inference framework with an easy-to-use, concise API for machine learning. 22 | 23 | * MXNet includes the Gluon interface that allows developers of all skill levels to get started with deep learning on the cloud, on edge devices, and on mobile apps. 24 | * In just a few lines of Gluon code, you can build linear regression, convolutional networks and recurrent LSTMs for object detection, speech recognition, recommendation, and personalization. 25 | 26 | * You can get started with MxNet on AWS with a fully-managed experience using SageMaker, a platform to build, train, and deploy machine learning models at scale. 27 | * Or, you can use the AWS Deep Learning AMIs to build custom environments and workflows with MxNet as well as other frameworks including TensorFlow, PyTorch, Chainer, Keras, Caffe, Caffe2, and Microsoft Cognitive Toolkit. 28 | 29 | # AWS Deep Learning AMIs 30 | 31 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ath0p0n3po5aphp8ocxe.png) 32 | 33 | * The AWS Deep Learning AMIs provide machine learning practitioners and researchers with the infrastructure and tools to accelerate deep learning in the cloud, at any scale. 34 | * You can quickly launch Amazon EC2 instances pre-installed with popular deep learning frameworks such as Apache MXNet and Gluon, TensorFlow, Microsoft Cognitive Toolkit, Caffe, Caffe2, Theano, Torch, PyTorch, Chainer, and Keras to train sophisticated, custom AI models, experiment with new algorithms, or to learn new skills and techniques. 35 | 36 | # AWS DeepComposer 37 | 38 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/tu6a84cqcz9bi8u30uem.png) 39 | 40 | * AWS DeepComposer is the world’s first musical keyboard powered by machine learning to enable developers of all skill levels to learn Generative AI while creating original music outputs. 41 | * DeepComposer consists of a USB keyboard that connects to the developer’s computer, and the DeepComposer service, accessed through the AWS Management Console. DeepComposer includes tutorials, sample code, and training data that can be used to start building generative models. 42 | 43 | # AWS DeepLens 44 | 45 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/21y0fol6syrao5l0e9nk.png) 46 | 47 | * AWS DeepLens helps put deep learning in the hands of developers, literally, with a fully programmable video camera, tutorials, code, and pre-trained models designed to expand deep learning skills. 48 | 49 | # AWS DeepRacer 50 | 51 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wuju4rgftb9j19trolfk.png) 52 | 53 | * AWS DeepRacer is a 1/18th scale race car which gives you an interesting and fun way to get started with reinforcement learning (RL). RL is an advanced machine learning (ML) technique which takes a very different approach to training models than other machine learning methods. 54 | * Its super power is that it learns very complex behaviors without requiring any labeled training data, and can make short term decisions while optimizing for a longer term goal. 55 | 56 | * With AWS DeepRacer, you now have a way to get hands-on with RL, experiment, and learn through autonomous driving. You can get started with the virtual car and tracks in the cloud-based 3D racing simulator, and for a real-world experience, you can deploy your trained models onto AWS DeepRacer and race your friends, or take part in the global AWS DeepRacer League. Developers, the race is on. 57 | 58 | # TensorFlow on AWS 59 | 60 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/050ru8hzki23v0nfm7la.png) 61 | 62 | * TensorFlow enables developers to quickly and easily get started with deep learning in the cloud. The framework has broad support in the industry and has become a popular choice for deep learning research and application development, particularly in areas such as computer vision, natural language understanding and speech translation. 63 | 64 | * You can get started on AWS with a fully-managed TensorFlow experience with SageMaker, a platform to build, train, and deploy machine learning models at scale. 65 | * Or, you can use the AWS Deep Learning AMIs to build custom environments and workflows with TensorFlow and other popular frameworks including Apache MXNet, PyTorch, Caffe, Caffe2, Chainer, Gluon, Keras, and Microsoft Cognitive Toolkit. 66 | 67 | # AWS Inferentia 68 | 69 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ivoldaeydz7g43h9p9ex.png) 70 | 71 | * AWS Inferentia is a machine learning inference chip designed to deliver high performance at low cost. AWS Inferentia will support the TensorFlow, Apache MXNet, and PyTorch deep learning frameworks, as well as models that use the ONNX format. 72 | 73 | * Making predictions using a trained machine learning model–a process called inference–can drive as much as 90% of the compute costs of the application. Using Amazon Elastic Inference, developers can reduce inference costs by up to 75% by attaching GPU-powered inference acceleration to Amazon EC2 and SageMaker instances. 74 | * However, some inference workloads require an entire GPU or have extremely low latency requirements. Solving this challenge at low cost requires a dedicated inference chip. 75 | 76 | * AWS Inferentia provides high throughput, low latency inference performance at an extremely low cost. Each chip provides hundreds of TOPS (tera operations per second) of inference throughput to allow complex models to make fast predictions. 77 | * For even more performance, multiple AWS Inferentia chips can be used together to drive thousands of TOPS of throughput. AWS Inferentia will be available for use with SageMaker, Amazon EC2, and Amazon Elastic Inference. 78 | 79 | # Conclusion 80 | 81 | As AWS releases more and more services covering ML, they are helping to bridge the gap between having the traditional skill set of a ML engineer to those looking to venture into the ML arena for the first time. This is allowing people to become skilled with using ML technology without having to be an expert in the traditional skillset. 82 | 83 | Hope this guide helps you with the Introduction to Machine Learning with AWS - Part-3. 84 | 85 | Let me know your thoughts in the comment section 👇 86 | And if you haven't yet, make sure to follow me on below handles: 87 | 88 | 👋 **connect with me on [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/)** 89 | 🤓 **connect with me on [Twitter](https://twitter.com/adi_12_modi)** 90 | 🐱‍💻 **follow me on [github](https://github.com/AditModi)** 91 | ✍️ **Do Checkout [my blogs](https://aditmodi.hashnode.dev)** 92 | 93 | Like, share and follow me 🚀 for more content. 94 | 95 | {% user aditmodi %} -------------------------------------------------------------------------------- /Introduction to Management, Governance and Migration with AWS - Part 1.md: -------------------------------------------------------------------------------- 1 | With AWS, customers can enable, provision, and operate their environment for both business agility and governance control. AWS provides services for end-to-end IT lifecycle management, helping customers control and secure their environments, reduce costs, simplify compliance, and enhance operational efficiency. 2 | 3 | In this Blog Post, we will talk about AWS Management and Governance services. AWS Management and Governance services are built to manage highly dynamic cloud resources at massive scale. 4 | 5 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/xgsyhswelcds85rbsp1t.png) 6 | 7 | > **The Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 8 | 9 | # AWS Management and Governance Services 10 | 11 | * Customers can use AWS Management and Governance services to assess their resource utilization and identify ways to reduce costs. 12 | * AWS reduces complexity, offering a single control plane for customers to manage and govern their resources on AWS and on-premises. 13 | * AWS offers the broadest partner ecosystem for customers to extend and augment their management and governance system. 14 | 15 | * **Usecases**: 16 | * Establish a centrally managed, secure, multi-account AWS environment. 17 | * Manage your operations on AWS and on-premises. 18 | * Audit and remediate your resource configurations. 19 | * Improve the health of infrastructure and applications. 20 | * Build, provision, and share AWS and third-party resources. 21 | * Transform your business with cost transparency, forecasting, and optimization. 22 | 23 | ## Amazon CloudWatch 24 | 25 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/q3uhgrb4anlef7k0te8k.png) 26 | 27 | * Amazon CloudWatch is a monitoring and management service built for developers, system operators, site reliability engineers (SRE), and IT managers. 28 | * CloudWatch provides you with data and actionable insights to monitor your applications, understand and respond to system-wide performance changes, optimize resource utilization, and get a unified view of operational health. 29 | * CloudWatch collects monitoring and operational data in the form of logs, metrics, and events, providing you with a unified view of AWS resources, applications and services that run on AWS, and on-premises servers. 30 | * You can use CloudWatch to set high resolution alarms, visualize logs and metrics side by side, take automated actions, troubleshoot issues, and discover insights to optimize your applications, and ensure they are running smoothly. 31 | 32 | ## AWS Auto Scaling 33 | 34 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/pnebrakm3eyi892j7b93.png) 35 | 36 | * AWS Auto Scaling monitors your applications and automatically adjusts capacity to maintain steady, predictable performance at the lowest possible cost. 37 | * Using AWS Auto Scaling, it’s easy to setup application scaling for multiple resources across multiple services in minutes. The service provides a simple, powerful user interface that lets you build scaling plans for resources including Amazon EC2 instances and Spot Fleets, Amazon ECS tasks, Amazon DynamoDB tables and indexes, and Amazon Aurora Replicas. 38 | * AWS Auto Scaling makes scaling simple with recommendations that allow you to optimize performance, costs, or balance between them. If you’re already using Amazon EC2 Auto Scaling to dynamically scale your Amazon EC2 instances, you can now combine it with AWS Auto Scaling to scale additional resources for other AWS services. With AWS Auto Scaling, your applications always have the right resources at the right time. 39 | 40 | ## AWS Control Tower 41 | 42 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/t792nbhm49i790wb6ck1.png) 43 | 44 | * AWS Control Tower automates the set-up of a baseline environment, or landing zone, that is a secure, well-architected multi-account AWS environment. 45 | * The configuration of the landing zone is based on best practices that have been established by working with thousands of enterprise customers to create a secure environment that makes it easier to govern AWS workloads with rules for security, operations, and compliance. 46 | 47 | * As enterprises migrate to AWS, they typically have a large number of applications and distributed teams. They often want to create multiple accounts to allow their teams to work independently, while still maintaining a consistent level of security and compliance. 48 | * In addition, they use AWS’s management and security services, like AWS Organizations, AWS Service Catalog and AWS Config, that provide very granular controls over their workloads. 49 | * They want to maintain this control, but they also want a way to centrally govern and enforce the best use of AWS services across all the accounts in their environment. 50 | 51 | * Control Tower automates the set-up of their landing zone and configures AWS management and security services based on established best practices in a secure, compliant, multi-account environment. 52 | * Distributed teams are able to provision new AWS accounts quickly, while central teams have the peace of mind knowing that new accounts are aligned with centrally established, company-wide compliance policies. 53 | * This gives you control over your environment, without sacrificing the speed and agility AWS provides your development teams. 54 | 55 | ## AWS Systems Manager 56 | 57 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/m22z3rkcy6hox43qgvbj.png) 58 | 59 | * AWS Systems Manager gives you visibility and control of your infrastructure on AWS. Systems Manager provides a unified user interface so you can view operational data from multiple AWS services and allows you to automate operational tasks across your AWS resources. 60 | * With Systems Manager, you can group resources, like Amazon EC2 instances, Amazon S3 buckets, or Amazon RDS instances, by application, view operational data for monitoring and troubleshooting, and take action on your groups of resources. 61 | * Systems Manager simplifies resource and application management, shortens the time to detect and resolve operational problems, and makes it easy to operate and manage your infrastructure securely at scale. 62 | 63 | ## AWS Systems Manager contains the following tools: 64 | 65 | * **Resource groups:** Lets you create a logical group of resources associated with a particular workload such as different layers of an application stack, or production versus development environments. For example, you can group different layers of an application, such as the frontend web layer and the backend data layer. Resource groups can be created, updated, or removed programmatically through the API. 66 | 67 | * **Insights Dashboard:** Displays operational data that the AWS Systems Manager automatically aggregates for each resource group. Systems Manager eliminates the need for you to navigate across multiple AWS consoles to view your operational data. With Systems Manager you can view API call logs from AWS CloudTrail, resource configuration changes from AWS Config, software inventory, and patch compliance status by resource group. You can also easily integrate your Amazon CloudWatch Dashboards, AWS Trusted Advisor notifications, and AWS Personal Health Dashboard performance and availability alerts into your Systems Manager dashboard. Systems Manager centralizes all relevant operational data, so you can have a clear view of your infrastructure compliance and performance. 68 | 69 | * **Run Command:** Provides a simple way of automating common administrative tasks like remotely executing shell scripts or PowerShell commands, installing software updates, or making changes to the configuration of OS, software, EC2 and instances and servers in your on-premises data center. 70 | 71 | * **State Manager:** Helps you define and maintain consistent OS configurations such as firewall settings and anti-malware definitions to comply with your policies. You can monitor the configuration of a large set of instances, specify a configuration policy for the instances, and automatically apply updates or configuration changes. 72 | 73 | * **Inventory:** Helps you collect and query configuration and inventory information about your instances and the software installed on them. You can gather details about your instances such as installed applications, DHCP settings, agent detail, and custom items. You can run queries to track and audit your system configurations. 74 | 75 | * **Maintenance Window:** Lets you define a recurring window of time to run administrative and maintenance tasks across your instances. This ensures that installing patches and updates, or making other configuration changes does not disrupt business-critical operations. This helps improve your application availability. 76 | 77 | * **Patch Manager:** Helps you select and deploy operating system and software patches automatically across large groups of instances. You can define a maintenance window so that patches are applied only during set times that fit your needs. These capabilities help ensure that your software is always up to date and meets your compliance policies. 78 | 79 | * **Automation:** Simplifies common maintenance and deployment tasks, such as updating Amazon Machine Images (AMIs). Use the Automation feature to apply patches, update drivers and agents, or bake applications into your AMI using a streamlined, repeatable, and auditable process. 80 | 81 | * **Parameter Store:** Provides an encrypted location to store important administrative information such as passwords and database strings. The Parameter Store integrates with AWS KMS to make it easy to encrypt the information you keep in the Parameter Store. 82 | 83 | * **Distributor:** Helps you securely distribute and install software packages, such as software agents. Systems Manager Distributor allows you to centrally store and systematically distribute software packages while you maintain control over versioning. You can use Distributor to create and distribute software packages and then install them using Systems Manager Run Command and State Manager. Distributor can also use AWS Identity and Access Management (IAM) policies to control who can create or update packages in your account. You can use the existing IAM policy support for Systems Manager Run Command and State Manager to define who can install packages on your hosts. 84 | 85 | * **Session Manager:** Provides a browser-based interactive shell and CLI for managing Windows and Linux EC2 instances, without the need to open inbound ports, manage SSH keys, or use bastion hosts. Administrators can grant and revoke access to instances through a central location by using AWS Identity and Access Management (IAM) policies. This allows you to control which users can access each instance, including the option to provide non-root access to specified users. Once access is provided, you can audit which user accessed an instance and log each command to Amazon S3 or Amazon CloudWatch Logs using AWS CloudTrail. 86 | 87 | ## AWS CloudFormation 88 | 89 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/i21ry7vmlai7pdvakwik.png) 90 | 91 | * AWS CloudFormation gives developers and systems administrators an easy way to create and manage a collection of related AWS resources, provisioning and updating them in an orderly and predictable fashion. 92 | 93 | * You can use the AWS CloudFormation sample templates or create your own templates to describe your AWS resources, and any associated dependencies or runtime parameters, required to run your application. 94 | * You don’t need to figure out the order for provisioning AWS services or the subtleties of making those dependencies work. CloudFormation takes care of this for you. 95 | * After the AWS resources are deployed, you can modify and update them in a controlled and predictable way, in effect applying version control to your AWS infrastructure the same way you do with your software. 96 | * You can also visualize your templates as diagrams and edit them using a drag-and-drop interface with the AWS CloudFormation Designer. 97 | 98 | ## AWS CloudTrail 99 | 100 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/id6koxoom9dykih0na7q.png) 101 | 102 | * AWS CloudTrail is a web service that records AWS API calls for your account and delivers log files to you. The recorded information includes the identity of the API caller, the time of the API call, the source IP address of the API caller, the request parameters, and the response elements returned by the AWS service. 103 | 104 | * With CloudTrail, you can get a history of AWS API calls for your account, including API calls made using the AWS Management Console, AWS SDKs, command line tools, and higher-level AWS services (such as AWS CloudFormation). 105 | * The AWS API call history produced by CloudTrail enables security analysis, resource change tracking, and compliance auditing. 106 | 107 | ## AWS Config 108 | 109 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ue3t7zm90mq9vnthyru9.png) 110 | 111 | * AWS Config is a fully managed service that provides you with an AWS resource inventory, configuration history, and configuration change notifications to enable security and governance. The Config Rules feature enables you to create rules that automatically check the configuration of AWS resources recorded by AWS Config. 112 | 113 | * With AWS Config, you can discover existing and deleted AWS resources, determine your overall compliance against rules, and dive into configuration details of a resource at any point in time. These capabilities enable compliance auditing, security analysis, resource change tracking, and troubleshooting. 114 | 115 | ## AWS OpsWorks 116 | 117 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/uc186g9kow9a9hrruc11.png) 118 | 119 | * AWS OpsWorks is a configuration management service that provides managed instances of Chef and Puppet. Chef and Puppet are automation platforms that allow you to use code to automate the configurations of your servers. 120 | * OpsWorks lets you use Chef and Puppet to automate how servers are configured, deployed, and managed across your Amazon EC2 instances or on-premises compute environments. 121 | * OpsWorks has three offerings, AWS OpsWorks for Chef Automate, AWS OpsWorks for Puppet Enterprise, and AWS OpsWorks Stacks. 122 | 123 | ## AWS Service Catalog 124 | 125 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/471ifkcoh5oced1uruvh.png) 126 | 127 | * AWS Service Catalog allows organizations to create and manage catalogs of IT services that are approved for use on AWS. These IT services can include everything from virtual machine images, servers, software, and databases to complete multi-tier application architectures. 128 | * AWS Service Catalog allows you to centrally manage commonly deployed IT services and helps you achieve consistent governance and meet your compliance requirements, while enabling users to quickly deploy only the approved IT services they need. 129 | 130 | ## AWS Trusted Advisor 131 | 132 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/l4e8h760fpigw6vbtczl.png) 133 | 134 | * AWS Trusted Advisor is an online resource to help you reduce cost, increase performance, and improve security by optimizing your AWS environment. Trusted Advisor provides real-time guidance to help you provision your resources following AWS best practices. 135 | 136 | ## AWS Personal Health Dashboard 137 | 138 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/pqp94s2v7dx670iyigqu.png) 139 | 140 | * AWS Personal Health Dashboard provides alerts and remediation guidance when AWS is experiencing events that might affect you. While the Service Health Dashboard displays the general status of AWS services, Personal Health Dashboard gives you a personalized view into the performance and availability of the AWS services underlying your AWS resources. 141 | * The dashboard displays relevant and timely information to help you manage events in progress, and provides proactive notification to help you plan for scheduled activities. 142 | * With Personal Health Dashboard, alerts are automatically triggered by changes in the health of AWS resources, giving you event visibility and guidance to help quickly diagnose and resolve issues. 143 | 144 | ## AWS Managed Services 145 | 146 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3iytopiwi0kzu0zvi7i4.png) 147 | 148 | * AWS Managed Services provides ongoing management of your AWS infrastructure so you can focus on your applications. By implementing best practices to maintain your infrastructure, AWS Managed Services helps to reduce your operational overhead and risk. 149 | * AWS Managed Services automates common activities such as change requests, monitoring, patch management, security, and backup services, and provides full-lifecycle services to provision, run, and support your infrastructure. 150 | * Our rigor and controls help to enforce your corporate and security infrastructure policies, and enables you to develop solutions and applications using your preferred development approach. 151 | * AWS Managed Services improves agility, reduces cost, and unburdens you from infrastructure operations so you can direct resources toward differentiating your business. 152 | 153 | ## AWS Console Mobile Application 154 | 155 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/l6xm83scec4tcxdbhajt.png) 156 | 157 | * The AWS Console Mobile Application lets customers view and manage a select set of resources to support incident response while on-the-go. 158 | 159 | * The Console Mobile Application allows AWS customers to monitor resources through a dedicated dashboard and view configuration details, metrics, and alarms for select AWS services. 160 | * The Dashboard provides permitted users with a single view a resource's status, with real-time data on Amazon CloudWatch, Personal Health Dashboard, and AWS Billing and Cost Management. 161 | * Customers can view ongoing issues and follow through to the relevant CloudWatch alarm screen for a detailed view with graphs and configuration options. 162 | * In addition, customers can check on the status of specific AWS services, view detailed resource screens, and perform select actions. 163 | 164 | ## AWS License Manager 165 | 166 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/hj2dkhvos0edvan86oc2.png) 167 | 168 | * AWS License Manager makes it easier to manage licenses in AWS and on-premises servers from software vendors such as Microsoft, SAP, Oracle, and IBM. 169 | * AWS License Manager lets administrators create customized licensing rules that emulate the terms of their licensing agreements, and then enforces these rules when an instance of Amazon EC2 gets launched. 170 | * Administrators can use these rules to limit licensing violations, such as using more licenses than an agreement stipulates or reassigning licenses to different servers on a short-term basis. 171 | * The rules in AWS License Manager enable you to limit a licensing breach by physically stopping the instance from launching or by notifying administrators about the infringement. 172 | * Administrators gain control and visibility of all their licenses with the AWS License Manager dashboard and reduce the risk of non-compliance, misreporting, and additional costs due to licensing overages. 173 | 174 | * AWS License Manager integrates with AWS services to simplify the management of licenses across multiple AWS accounts, IT catalogs, and on-premises, through a single AWS account. 175 | * License administrators can add rules in AWS Service Catalog, which allows them to create and manage catalogs of IT services that are approved for use on all their AWS accounts. 176 | * Through seamless integration with AWS Systems Manager and AWS Organizations, administrators can manage licenses across all the AWS accounts in an organization and on-premises environments. 177 | * AWS Marketplace buyers can also use AWS License Manager to track bring your own license (BYOL) software obtained from the Marketplace and keep a consolidated view of all their licenses. 178 | 179 | ## AWS Well-Architected Tool 180 | 181 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3j4rs0dyd9hntim319cv.png) 182 | 183 | * The AWS Well-Architected Tool helps you review the state of your workloads and compares them to the latest AWS architectural best practices. 184 | * The tool is based on the AWS Well-Architected Framework, developed to help cloud architects build secure, high-performing, resilient, and efficient application infrastructure. 185 | * This Framework provides a consistent approach for customers and partners to evaluate architectures, has been used in tens of thousands of workload reviews conducted by the AWS solutions architecture team, and provides guidance to help implement designs that scale with application needs over time. 186 | 187 | * To use this free tool, available in the AWS Management Console, just define your workload and answer a set of questions regarding operational excellence, security, reliability, performance efficiency, and cost optimization. 188 | * The AWS Well-Architected Tool then provides a plan on how to architect for the cloud using established best practices. 189 | 190 | # Conclusion 191 | 192 | * In the past, organizations have had to choose between innovating faster and maintaining control over cost, compliance, and security. 193 | * With AWS Management and Governance services, customers don’t have to choose between innovation and control—they can have both. * With AWS, customers can enable, provision, and operate their environment for both business agility and governance control. 194 | 195 | Hope this guide helps you with the Introduction to Management, Governance and Migration with AWS- Part-1. In the next blog post, we will discuss some of the most important Migration services in AWS. 196 | 197 | Let me know your thoughts in the comment section 👇 198 | And if you haven't yet, make sure to follow me on below handles: 199 | 200 | 👋 **connect with me on [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/)** 201 | 🤓 **connect with me on [Twitter](https://twitter.com/adi_12_modi)** 202 | 🐱‍💻 **follow me on [github](https://github.com/AditModi)** 203 | ✍️ **Do Checkout [my blogs](https://aditmodi.hashnode.dev)** 204 | 205 | Like, share and follow me 🚀 for more content. 206 | 207 | {% user aditmodi %} -------------------------------------------------------------------------------- /Introduction to Management, Governance and Migration with AWS - Part 2.md: -------------------------------------------------------------------------------- 1 | Customers are able to decrease their IT costs by moving infrastructure and applications to the cloud, and are able to free up resources to focus on what truly differentiates their business. By migrating legacy applications to the cloud, customers routinely save 70-80%. Customers who move to AWS from on-premises achieve fewer downtime hours, enabling a better customer experience. Customers who migrate to AWS gain in staff productivity and increase in agility. 2 | 3 | In this blog post, we will discuss some of the most important AWS Migration Services. Moving from an on-premises environment, hosting facility, or other public cloud to AWS, customers can benefit from IT cost savings, productivity improvements, business agility, and operational resilience. 4 | 5 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3ebd98uopcfxy959t52k.png) 6 | 7 | > **The Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 8 | 9 | # AWS Migration Services 10 | 11 | * AWS uses real customer results over years of migrations to continuously develop and refine our services. 12 | * AWS helps customers achieve your desired business outcomes with an end-to-end set of first-party and third-party tools and services. 13 | * AWS helps customers lift-and-shift, refactor, or modernize their workloads. 14 | * AWS can help you improve operational efficiency and application performance quickly. 15 | * AWS has been providing organizations with a secure global cloud presence since 2006. 16 | 17 | ## AWS Migration Hub 18 | 19 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/8ko1cbufpyypeqxvwgbp.png) 20 | 21 | * AWS Migration Hub provides a single location to track the progress of application migrations across multiple AWS and partner solutions. Using Migration Hub allows you to choose the AWS and partner migration tools that best fit your needs, while providing visibility into the status of migrations across your portfolio of applications. 22 | 23 | * Migration Hub also provides key metrics and progress for individual applications, regardless of which tools are being used to migrate them. For example, you might use AWS Database Migration Service, AWS Server Migration Service, and partner migration tools such as ATADATA ATAmotion, CloudEndure Live Migration, or RiverMeadow Server Migration Saas to migrate an application comprised of a database, virtualized web servers, and a bare metal server. 24 | 25 | * Using Migration Hub, you can view the migration progress of all the resources in the application. This allows you to quickly get progress updates across all of your migrations, easily identify and troubleshoot any issues, and reduce the overall time and effort spent on your migration projects. 26 | 27 | ## AWS Application Discovery Service 28 | 29 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/t0hl5vsie3gh7qw2rerp.png) 30 | 31 | * AWS Application Discovery Service helps enterprise customers plan migration projects by gathering information about their on-premises data centers. 32 | 33 | * Planning data center migrations can involve thousands of workloads that are often deeply interdependent. Server utilization data and dependency mapping are important early first steps in the migration process. AWS Application Discovery Service collects and presents configuration, usage, and behavior data from your servers to help you better understand your workloads. 34 | 35 | * The collected data is retained in encrypted format in an AWS Application Discovery Service data store. You can export this data as a CSV file and use it to estimate the Total Cost of Ownership (TCO) of running on AWS and to plan your migration to AWS. 36 | 37 | * In addition, this data is also available in AWS Migration Hub, where you can migrate the discovered servers and track their progress as they get migrated to AWS. 38 | 39 | ## AWS Server Migration Service 40 | 41 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ecu5u4zu0wmt585iyc5c.png) 42 | 43 | * AWS Server Migration Service (SMS) is an agentless service which makes it easier and faster for you to migrate thousands of on-premises workloads to AWS. AWS SMS allows you to automate, schedule, and track incremental replications of live server volumes, making it easier for you to coordinate large-scale server migrations. 44 | 45 | ## AWS DataSync 46 | 47 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ojymypmyaqftd1of7yoy.png) 48 | 49 | * AWS DataSync is a data transfer service that makes it easy for you to automate moving data between on-premises storage and Amazon S3 or Amazon Elastic File System (Amazon EFS). 50 | 51 | * DataSync automatically handles many of the tasks related to data transfers that can slow down migrations or burden your IT operations, including running your own instances, handling encryption, managing scripts, network optimization, and data integrity validation. 52 | 53 | * You can use DataSync to transfer data at speeds up to 10 times faster than open-source tools. DataSync uses an on-premises software agent to connect to your existing storage or file systems using the Network File System (NFS) protocol, so you don’t have write scripts or modify your applications to work with AWS APIs. 54 | 55 | * You can use DataSync to copy data over AWS Direct Connect or internet links to AWS. The service enables one-time data migrations, recurring data processing workflows, and automated replication for data protection and recovery. Getting started with DataSync is easy: Deploy the DataSync agent on premises, connect it to a file system or storage array, select Amazon EFS or S3 as your AWS storage, and start moving data. You pay only for the data you copy. 56 | 57 | ## AWS Transfer Family 58 | 59 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/j2pwd19kx5g8w67z7mnd.png) 60 | 61 | * AWS Transfer Family provides fully managed support for file transfers directly into and out of Amazon S3 or Amazon EFS. With support for Secure File Transfer Protocol (SFTP), File Transfer Protocol over SSL (FTPS), and File Transfer Protocol (FTP), the AWS Transfer Family helps you seamlessly migrate your file transfer workflows to AWS by integrating with existing authentication systems, and providing DNS routing with Amazon Route 53 so nothing changes for your customers and partners, or their applications. 62 | 63 | * With your data in Amazon S3 or Amazon EFS, you can use it with AWS services for processing, analytics, machine learning, archiving, as well as home directories and developer tools. Getting started with the AWS Transfer Family is easy; there is no infrastructure to buy and set up. 64 | 65 | ## AWS Migration Evaluator 66 | 67 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/2rnxjrap4kxumcir5knl.png) 68 | 69 | * Creating a business case on your own can be a time-consuming process and does not always identify the most cost-effective options. A business case is the first step in your migration journey. 70 | 71 | * With Migration Evaluator (Formerly TSO Logic), you can gain access to insights and accelerate decision-making for migration to AWS at no cost. Following data collection, you will quickly receive an assessment including a projected cost estimate and savings of running your on-premises workloads in the AWS Cloud. 72 | 73 | * After receiving your initial assessment, your organization can work with the Migration Evaluator team to create a directional business case if additional insights are needed. The team will capture your migration objective and use analytics to narrow down the migration patterns best suited to your business needs. 74 | 75 | * Your organization gets access to AWS expertise, visibility into the costs associated with multiple migration strategies, and insights on how reusing existing software licensing reduces costs further. Results are captured in a transparent business case report to further align business and technology stakeholders, while providing a prescriptive next step in your migration journey. 76 | 77 | ## AWS Application Migration Service 78 | 79 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/oygu7rrebesnho6vgyku.png) 80 | 81 | * AWS Application Migration Service (AWS MGN) allows you to quickly realize the benefits of migrating applications to the cloud without changes and with minimal downtime. 82 | 83 | * AWS Application Migration Service minimizes time-intensive, error-prone manual processes by automatically converting your source servers from physical, virtual, or cloud infrastructure to run natively on AWS. It further simplifies your migration by enabling you to use the same automated process for a wide range of applications. 84 | 85 | * And by launching non-disruptive tests before migrating, you can be confident that your most critical applications such as SAP, Oracle, and SQL Server will work seamlessly on AWS. 86 | 87 | ## AWS Database Migration Service 88 | 89 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3sw3vwe9sfv0nc2emsew.png) 90 | 91 | * AWS Database Migration Service helps you migrate databases to AWS easily and securely. The source database remains fully operational during the migration, minimizing downtime to applications that rely on the database. 92 | 93 | * The AWS Database Migration Service can migrate your data to and from most widely used commercial and open-source databases. The service supports homogeneous migrations such as Oracle to Oracle, as well as heterogeneous migrations between different database platforms, such as Oracle to Amazon Aurora or Microsoft SQL Server to MySQL. 94 | 95 | * It also allows you to stream data to Amazon Redshift from any of the supported sources including Amazon Aurora, PostgreSQL, MySQL, MariaDB, Oracle, SAP ASE, and SQL Server, enabling consolidation and easy analysis of data in the petabyte-scale data warehouse. AWS Database Migration Service can also be used for continuous data replication with high availability. 96 | 97 | ## AWS Snowball 98 | 99 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/sy9iodqf9yw8lbod4s5b.png) 100 | 101 | * AWS Snowball is a petabyte-scale data transport solution that uses secure appliances to transfer large amounts of data into and out of AWS. The use of Snowball addresses common challenges with large-scale data transfers including high network costs, long transfer times, and security concerns. Transferring data with Snowball is simple, fast, secure, and can be as little as one-fifth the cost of high-speed Internet. 102 | 103 | * With Snowball, you don’t need to write any code or purchase any hardware to transfer your data. Simply create a job in the AWS Management Console and a Snowball appliance will be automatically shipped to you. Once it arrives, attach the appliance to your local network, download and run the Snowball client to establish a connection, and then use the client to select the file directories that you want to transfer to the appliance. 104 | 105 | * The client will then encrypt and transfer the files to the appliance at high speed. Once the transfer is complete and the appliance is ready to be returned, the E Ink shipping label will automatically update and you can track the job status using the Amazon Simple Notification Service (SNS), text messages, or directly in the console. 106 | 107 | * Snowball uses multiple layers of security designed to protect your data including tamper-resistant enclosures, 256-bit encryption, and an industry-standard Trusted Platform Module (TPM) designed to ensure both security and full chain of custody of your data. Once the data transfer job has been processed and verified, AWS performs a software erasure of the Snowball appliance. 108 | 109 | ## AWS Snowball Edge 110 | 111 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/frpdar29y5xsebmekc2s.png) 112 | 113 | * AWS Snowball Edge is a data migration and edge computing device that comes in two options. Snowball Edge Storage Optimized provides 80 TB of capacity and 24 vCPUs and is well suited for local storage and large scale data transfer. 114 | 115 | * Snowball Edge Compute Optimized provides 52 vCPUs and an optional GPU for use cases such as advanced machine learning and full motion video analysis in disconnected environments. 116 | 117 | * Customers can use these two options for data collection, machine learning and processing, and storage in environments with intermittent connectivity (such as manufacturing, industrial, and transportation) or in extremely remote locations (such as military or maritime operations) before shipping it back to AWS. These devices may also be rack mounted and clustered together to build larger, temporary installations. 118 | 119 | * Snowball Edge supports specific Amazon EC2 instance types as well as AWS Lambda functions, so customers may develop and test in AWS then deploy applications on devices in remote locations to collect, pre-process, and return the data. Common use cases include data migration, data transport, image collation, IoT sensor stream capture, and machine learning. 120 | 121 | ## AWS Snowmobile 122 | 123 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/gt0yzool7znpklzbhhd5.png) 124 | 125 | * AWS Snowmobile is an exabyte-scale data transfer service used to move extremely large amounts of data to AWS. You can transfer up to 100 PB per Snowmobile, a 45-foot long ruggedized shipping container, pulled by a semi-trailer truck. 126 | 127 | * Snowmobile makes it easy to move massive volumes of data to the cloud, including video libraries, image repositories, or even a complete data center migration. Transferring data with Snowmobile is secure, fast, and cost effective. 128 | 129 | * After an initial assessment, a Snowmobile will be transported to your data center, and AWS personnel will configure it for you so it can be accessed as a network storage target. When your Snowmobile is on site, AWS personnel will work with your team to connect a removable, high-speed network switch from the Snowmobile to your local network. 130 | 131 | * Then you can begin your high-speed data transfer from any number of sources within your data center to the Snowmobile. After your data is loaded, the Snowmobile is driven back to AWS where your data is imported into Amazon S3 or S3 Glacier. 132 | 133 | * AWS Snowmobile uses multiple layers of security designed to protect your data including dedicated security personnel, GPS tracking, alarm monitoring, 24/7 video surveillance, and an optional escort security vehicle while in transit. 134 | 135 | * All data is encrypted with 256-bit encryption keys managed through AWS KMS and designed to ensure both security and full chain of custody of your data. 136 | 137 | # Conclusion 138 | 139 | * Accelerate your migration and modernization journey to the cloud. AWS offers a wide range of migration solutions to help migrate workloads from on-premises environments, hosting facilities, or other public clouds. 140 | * Select from services for transferring and modernizing applications, websites, databases, storage, physical and virtual servers, or even entire data centers. 141 | 142 | Hope this guide helps you with the Introduction to Management, Governance and Migration with AWS - Part-2. 143 | 144 | Let me know your thoughts in the comment section 👇 145 | And if you haven't yet, make sure to follow me on below handles: 146 | 147 | 👋 **connect with me on [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/)** 148 | 🤓 **connect with me on [Twitter](https://twitter.com/adi_12_modi)** 149 | 🐱‍💻 **follow me on [github](https://github.com/AditModi)** 150 | ✍️ **Do Checkout [my blogs](https://aditmodi.hashnode.dev)** 151 | 152 | Like, share and follow me 🚀 for more content. 153 | 154 | {% user aditmodi %} -------------------------------------------------------------------------------- /Introduction to Mobile and Web Apps with AWS.md: -------------------------------------------------------------------------------- 1 | AWS offers a wide range of tools and services to support development workflows for iOS, Android, React Native, and web front-end developers. There is a set of services that make it easy to build, test, and deploy an application, even with minimal knowledge of AWS. With the speed and reliability of the AWS infrastructure, mobile and web applications can scale from prototype to millions of users to provide a better user experience and better solutions for the whole integrated system. 2 | 3 | A scalable approach allows you to grow your business quickly with built-in AWS best practices for security, availability, and reliability; your application can easily scale from one request per second with microsecond latency around the world. 4 | 5 | In this blog post, we will discuss some of the most important AWS Mobile and Web App services that will help you in the development and operation of web and mobile solutions, as well as speed up the whole process and make it more stable. 6 | 7 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3ydtjtj9ozqwqb0cfv1u.png) 8 | 9 | > **The Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 10 | 11 | # AWS Mobile and Web App Services 12 | 13 | * AWS offers purpose-built tools and services for front-end web and mobile developers, which makes it easier to build apps with cloud functionality on AWS, so you can get to market faster. 14 | 15 | * AWS provides an end-to-end solution so you can develop, deliver, test, and monitor your app. you can also combine front-end tools with the breadth and depth of AWS services to support your evolving business requirements. 16 | 17 | # AWS Amplify 18 | 19 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ut2fjkku28ipz4cnylez.png) 20 | 21 | * AWS Amplify makes it easy to create, configure, and implement scalable mobile applications powered by AWS. Amplify seamlessly provisions and manages your mobile backend and provides a simple framework to easily integrate your backend with your iOS, Android, Web, and React Native frontends. 22 | 23 | * Amplify also automates the application release process of both your frontend and backend allowing you to deliver features faster. 24 | 25 | * Mobile applications require cloud services for actions that can’t be done directly on the device, such as offline data synchronization, storage, or data sharing across multiple users. You often have to configure, set up, and manage multiple services to power the backend. 26 | 27 | * You also have to integrate each of those services into your application by writing multiple lines of code. However, as the number of application features grow, your code and release process becomes more complex and managing the backend requires more time. 28 | 29 | * Amplify provisions and manages backends for your mobile applications. You just select the capabilities you need such as authentication, analytics, or offline data sync and Amplify will automatically provision and manage the AWS service that powers each of the capabilities. 30 | 31 | * You can then integrate those capabilities into your application through the Amplify libraries and UI components. 32 | 33 | # Amazon Cognito 34 | 35 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/udt25l9bfsm0i04d5hcg.png) 36 | 37 | 38 | * Amazon Cognito lets you add user sign-up, sign-in, and access control to your web and mobile apps quickly and easily. With Amazon Cognito, you also have the option to authenticate users through social identity providers such as Facebook, Twitter, or Amazon, with SAML identity solutions, or by using your own identity system. 39 | 40 | * In addition, Amazon Cognito enables you to save data locally on users’ devices, allowing your applications to work even when the devices are offline. You can then synchronize data across users’ devices so that their app experience remains consistent regardless of the device they use. 41 | 42 | * With Amazon Cognito, you can focus on creating great app experiences instead of worrying about building, securing, and scaling a solution to handle user management, authentication, and sync across devices. 43 | 44 | # Amazon Pinpoint 45 | 46 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/7i133ig560ohxkrowumf.png) 47 | 48 | * Amazon Pinpoint makes it easy to send targeted messages to your customers through multiple engagement channels. Examples of targeted campaigns are promotional alerts and customer retention campaigns, and transactional messages are messages such as order confirmations and password reset messages. 49 | 50 | * You can integrate Amazon Pinpoint into your mobile and web apps to capture usage data to provide you with insight into how customers interact with your apps. 51 | 52 | * Amazon Pinpoint also tracks the ways that your customers respond to the messages you send—for example, by showing you the number of messages that were delivered, opened, or clicked. 53 | 54 | * You can develop custom audience segments and send them pre-scheduled targeted campaigns via email, SMS, and push notifications. Targeted campaigns are useful for sending promotional or educational content to re-engage and retain your users. 55 | 56 | * You can send transactional messages using the console or the Amazon Pinpoint REST API. Transactional campaigns can be sent via email, SMS, push notifications, and voice messages. You can also use the API to build custom applications that deliver campaign and transactional messages. 57 | 58 | # AWS Device Farm 59 | 60 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/yk3oda3ccqph5eci4wef.png) 61 | 62 | * AWS Device Farm is an app testing service that lets you test and interact with your Android, iOS, and web apps on many devices at once, or reproduce issues on a device in real time. View video, screenshots, logs, and performance data to pinpoint and fix issues before shipping your app. 63 | 64 | 65 | 66 | # Amazon Location Service 67 | 68 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/bwu104erzc36axj1xw41.png) 69 | 70 | * Amazon Location Service provides affordable data, tracking and geofencing capabilities, and native integrations with AWS services, so you can create sophisticated location-enabled applications quickly, without the high cost of custom development. 71 | 72 | * You retain control of your location data with Amazon Location, and you can combine proprietary data with data from the service. Amazon Location provides cost-effective location-based services (LBS) using high-quality data from global, trusted providers Esri and HERE. 73 | 74 | # Amazon Chime SDK 75 | 76 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/f5jutojjxwydb5dyr9vx.png) 77 | 78 | * The Amazon Chime SDK is a set of real-time communications components that developers can use to quickly add messaging, audio, video, and screen sharing capabilities to their web or mobile applications. 79 | 80 | * Developers can leverage the same communication infrastructure and services that power Amazon Chime, an online meetings service from AWS, and deliver engaging experiences in their applications. 81 | 82 | * For instance, they can add video to a health application so patients can consult with doctors on health issues remotely, or create customized audio prompts for integration with the public telephone network. 83 | 84 | * By using the Amazon Chime SDK, developers can help eliminate the cost, complexity, and friction of creating and maintaining their own real-time communication infrastructure and services. 85 | 86 | # AWS App Runner 87 | 88 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/eoobx5kae5gmwaap8rxd.png) 89 | 90 | * AWS App Runner is a fully managed service that makes it easy for developers to quickly deploy containerized web applications and APIs, at scale and with no prior infrastructure experience required. Start with your source code or a container image. 91 | 92 | * App Runner automatically builds and deploys the web application and load balances traffic with encryption. App Runner also scales up or down automatically to meet your traffic needs. With App Runner, rather than thinking about servers or scaling, you have more time to focus on your applications. 93 | 94 | # AWS AppSync 95 | 96 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/tpdrt5oftfyfj1xpplo5.png) 97 | 98 | * AWS AppSync is a serverless back-end for mobile, web, and enterprise applications. 99 | 100 | * AWS AppSync makes it easy to build data driven mobile and web applications by handling securely all the application data management tasks like online and offline data access, data synchronization, and data manipulation across multiple data sources. 101 | 102 | * AWS AppSync uses GraphQL, an API query language designed to build client applications by providing an intuitive and flexible syntax for describing their data requirement. 103 | 104 | * Amazon Location Service makes it easy for developers to add location functionality to applications without compromising data security and user privacy. 105 | 106 | * Location data is a vital ingredient in today’s applications, enabling capabilities ranging from asset tracking to location-based marketing. 107 | 108 | * However, developers face significant barriers when integrating location functionality into their applications. This includes cost, privacy and security compromises, and tedious and slow integration work. 109 | 110 | # Conclusion 111 | 112 | * Today, the development of mobile and web applications is closely related to cloud services in the form of a backend. The bulk of functionality in mobile and web applications is designed to communicate with the backend and to make calls to the corresponding API. 113 | 114 | * Amazon’s system to develop mobile applications is constantly being updated with interesting functions. It also offers an authentication system, the ability to quickly build flexible APIs via GraphQL, and the ability to test in the cloud using real devices, which is essential for testers. 115 | 116 | Hope this guide gives you an Introduction to Mobile and Web Apps with AWS. 117 | 118 | Let me know your thoughts in the comment section 👇 119 | And if you haven't yet, make sure to follow me on below handles: 120 | 121 | 👋 **connect with me on [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/)** 122 | 🤓 **connect with me on [Twitter](https://twitter.com/adi_12_modi)** 123 | 🐱‍💻 **follow me on [github](https://github.com/AditModi)** 124 | ✍️ **Do Checkout [my blogs](https://aditmodi.hashnode.dev)** 125 | 126 | Like, share and follow me 🚀 for more content. 127 | 128 | {% user aditmodi %} -------------------------------------------------------------------------------- /Introduction to Networking and Content Delivery with AWS.md: -------------------------------------------------------------------------------- 1 | When most people think of the Internet, they think of a magical cloud that lets you access your favorite websites, shop online, and your seemingly endless stream of movies and web series. But in reality, there isn’t any magic involved. There’s no mysterious entity that grants us an online resource. The Internet is just an interconnection of computers around the world, like a giant spider web that brings all of us together. We call the interconnection of computers, a network. 2 | 3 | By using a cloud network an organization can deliver content more rapidly, reliably, and securely, without having to bear the costs and difficulties of building and operating its own network. 4 | 5 | Many organizations around the world are deciding to move their workloads to the cloud, and it’s only a matter of time before it gains universal adoption. The demand for the AWS backbone to support the interconnectivity needs of all types of business models will continue to grow and the need for highly available cloud-based services will grow with it. AWS is the cloud leader and thus uniquely positioned with the greatest potential and customer base to respond to those growing needs and power the innovations needed to continue to move the needle. 6 | 7 | In this blog post, we will discuss some of the most important AWS networking services that help you quickly set up, secure, and monitor your network. This services improve security, availability, performance, and help with streamlined monitoring both on-premises as well as on AWS cloud. 8 | 9 | ![Introduction to Developer Tools with AWS](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/p0te04q232j69ky1eezy.png) 10 | 11 | *My Background: Cloud Engineer | AWS Community Builder | AWS Educate Cloud Ambassador | 4x AWS Certified | 3x OCI Certified | 3x Azure Certified.* 12 | 13 | The Introduction to AWS is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 14 | 15 | # Networking and Content Delivery 16 | 17 | AWS provides the broadest and deepest set of networking services with the highest reliability, most security features, and highest performance in the world. This helps ensure you can run any kind of workload you have in the cloud. 18 | 19 | ## Amazon VPC 20 | 21 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/oqyneq3i6kcuf3h46vfl.png) 22 | 23 | 24 | Amazon Virtual Private Cloud (Amazon VPC) lets you provision a logically isolated section of the AWS Cloud where you can launch AWS resources in a virtual network that you define. You have complete control over your virtual networking environment, including selection of your own IP address range, creation of subnets, and configuration of route tables and network gateways. You can use both IPv4 and IPv6 in your VPC for secure and easy access to resources and applications. 25 | 26 | You can easily customize the network configuration for your VPC. For example, you can create a public-facing subnet for your web servers that has access to the Internet, and place your backend systems, such as databases or application servers, in a private-facing subnet with no Internet access. You can leverage multiple layers of security (including security groups and network access control lists) to help control access to EC2 instances in each subnet. 27 | 28 | Additionally, you can create a hardware virtual private network (VPN) connection between your corporate data center and your VPC and leverage the AWS Cloud as an extension of your corporate data center. 29 | 30 | ## Amazon CloudFront 31 | 32 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/259255aqlrxend85ix5q.png) 33 | 34 | 35 | Amazon CloudFront is a fast content delivery network (CDN) service that securely delivers data, videos, applications, and APIs to customers globally with low latency, high transfer speeds, all within a developer-friendly environment. CloudFront is integrated with AWS – both physical locations that are directly connected to the AWS global infrastructure, as well as other AWS services. CloudFront works seamlessly with services including AWS Shield for DDoS mitigation, Amazon S3, Elastic Load Balancing or Amazon EC2 as origins for your applications, and Lambda@Edge to run custom code closer to customers’ users and to customize the user experience. 36 | 37 | You can get started with the Content Delivery Network in minutes, using the same AWS tools that you're already familiar with: APIs, AWS Management Console, AWS CloudFormation, CLIs, and SDKs. Amazon's CDN offers a simple, pay-as-you-go pricing model with no upfront fees or required long-term contracts, and support for the CDN is included in your existing AWS Support subscription. 38 | 39 | ## Amazon Route 53 40 | 41 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/lah64ii86hh3si5tgwle.png) 42 | 43 | 44 | Amazon Route 53 is a highly available and scalable cloud Domain Name System (DNS) web service. It is designed to give developers and businesses an extremely reliable and cost-effective way to route end users to Internet applications by translating human readable names, such as www.example.com, into the numeric IP addresses, such as 192.0.2.1, that computers use to connect to each other. Amazon Route 53 is fully compliant with IPv6 as well. 45 | 46 | Amazon Route 53 effectively connects user requests to infrastructure running in AWS—such as EC2 instances, Elastic Load Balancing load balancers, or Amazon S3 buckets—and can also be used to route users to infrastructure outside of AWS. You can use Amazon Route 53 to configure DNS health checks to route traffic to healthy endpoints or to independently monitor the health of your application and its endpoints. Amazon Route 53 traffic flow makes it easy for you to manage traffic globally through a variety of routing types, including latency-based routing, Geo DNS, and weighted round robin—all of which can be combined with DNS Failover in order to enable a variety of low-latency, fault-tolerant architectures. Using Amazon Route 53 traffic flow’s simple visual editor, you can easily manage how your end users are routed to your application’s endpoints—whether in a single AWS Region or distributed around the globe. Amazon Route 53 also offers Domain Name Registration—you can purchase and manage domain names such as example.com and Amazon Route 53 will automatically configure DNS settings for your domains. 47 | 48 | ## AWS PrivateLink 49 | 50 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/y5d6l9kuxrvh9plskvi1.png) 51 | 52 | 53 | AWS PrivateLink simplifies the security of data shared with cloud-based applications by eliminating the exposure of data to the public Internet. AWS PrivateLink provides private connectivity between VPCs, AWS services, and on-premises applications, securely on the Amazon network. AWS PrivateLink makes it easy to connect services across different accounts and VPCs to significantly simplify the network architecture. 54 | 55 | ## AWS Direct Connect 56 | 57 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/m6rbybapefw6m8qzsnk4.png) 58 | 59 | 60 | AWS Direct Connect makes it easy to establish a dedicated network connection from your premises to AWS. Using AWS Direct Connect, you can establish private connectivity between AWS and your data center, office, or co-location environment, which in many cases can reduce your network costs, increase bandwidth throughput, and provide a more consistent network experience than Internet-based connections. 61 | 62 | AWS Direct Connect lets you establish a dedicated network connection between your network and one of the AWS Direct Connect locations. Using industry standard 802.1Q virtual LANS (VLANs), this dedicated connection can be partitioned into multiple virtual interfaces. This allows you to use the same connection to access public resources, such as objects stored in Amazon S3 using public IP address space, and private resources such as EC2 instances running within a VPC using private IP address space, while maintaining network separation between the public and private environments. Virtual interfaces can be reconfigured at any time to meet your changing needs. 63 | 64 | ## AWS Global Accelerator 65 | 66 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/zdy2ry35yxeipgtnvkec.png) 67 | 68 | 69 | AWS Global Accelerator is a networking service that improves the availability and performance of the applications that you offer to your global users. 70 | 71 | Today, if you deliver applications to your global users over the public internet, your users might face inconsistent availability and performance as they traverse through multiple public networks to reach your application. These public networks are often congested and each hop can introduce availability and performance risk. AWS Global Accelerator uses the highly available and congestion-free AWS global network to direct internet traffic from your users to your applications on AWS, making your users’ experience more consistent. 72 | 73 | To improve the availability of your application, you must monitor the health of your application endpoints and route traffic only to healthy endpoints. AWS Global Accelerator improves application availability by continuously monitoring the health of your application endpoints and routing traffic to the closest healthy endpoints. 74 | 75 | AWS Global Accelerator also makes it easier to manage your global applications by providing static IP addresses that act as a fixed entry point to your application hosted on AWS which eliminates the complexity of managing specific IP addresses for different AWS Regions and Availability Zones. AWS Global Accelerator is easy to set up, configure and manage. 76 | 77 | 78 | ## AWS Transit Gateway 79 | 80 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/bzmxojf4jfhbp8daheej.png) 81 | 82 | 83 | AWS Transit Gateway is a service that enables customers to connect their Amazon Virtual Private Clouds (VPCs) and their on-premises networks to a single gateway. As you grow the number of workloads running on AWS, you need to be able to scale your networks across multiple accounts and Amazon VPCs to keep up with the growth. Today, you can connect pairs of Amazon VPCs using peering. However, managing point-to-point connectivity across many Amazon VPCs, without the ability to centrally manage the connectivity policies, can be operationally costly and cumbersome. For on-premises connectivity, you need to attach your AWS VPN to each individual Amazon VPC. This solution can be time consuming to build and hard to manage when the number of VPCs grows into the hundreds. 84 | 85 | With AWS Transit Gateway, you only have to create and manage a single connection from the central gateway in to each Amazon VPC, on-premises data center, or remote office across your network. Transit Gateway acts as a hub that controls how traffic is routed among all the connected networks which act like spokes. This hub and spoke model significantly simplifies management and reduces operational costs because each network only has to connect to the Transit Gateway and not to every other network. Any new VPC is simply connected to the Transit Gateway and is then automatically available to every other network that is connected to the Transit Gateway. This ease of connectivity makes it easy to scale your network as you grow. 86 | 87 | ## AWS App Mesh 88 | 89 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ggd95claa3uism093gh4.png) 90 | 91 | 92 | AWS App Mesh makes it easy to monitor and control microservices running on AWS. App Mesh standardizes how your microservices communicate, giving you end-to-end visibility and helping to ensure high-availability for your applications. 93 | 94 | Modern applications are often composed of multiple microservices that each perform a specific function. This architecture helps to increase the availability and scalability of the application by allowing each component to scale independently based on demand, and automatically degrading functionality when a component fails instead of going offline. Each microservice interacts with all the other microservices through an API. As the number of microservices grows within an application, it becomes increasingly difficult to pinpoint the exact location of errors, re-route traffic after failures, and safely deploy code changes. Previously, this has required you to build monitoring and control logic directly into your code and redeploy your microservices every time there are changes. 95 | 96 | AWS App Mesh makes it easy to run microservices by providing consistent visibility and network traffic controls for every microservice in an application. App Mesh removes the need to update application code to change how monitoring data is collected or traffic is routed between microservices. App Mesh configures each microservice to export monitoring data and implements consistent communications control logic across your application. This makes it easy to quickly pinpoint the exact location of errors and automatically re-route network traffic when there are failures or when code changes need to be deployed. 97 | 98 | You can use App Mesh with Amazon ECS and Amazon EKS to better run containerized microservices at scale. App Mesh uses the open source Envoy proxy, making it compatible with a wide range of AWS partner and open source tools for monitoring microservices. 99 | 100 | ## AWS Cloud Map 101 | 102 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/7wxc7c1b1suepw21kmav.png) 103 | 104 | 105 | AWS Cloud Map is a cloud resource discovery service. With Cloud Map, you can define custom names for your application resources, and it maintains the updated location of these dynamically changing resources. This increases your application availability because your web service always discovers the most up-to-date locations of its resources. 106 | 107 | Modern applications are typically composed of multiple services that are accessible over an API and perform a specific function. Each service interacts with a variety of other resources such as databases, queues, object stores, and customer-defined microservices, and they also need to be able to find the location of all the infrastructure resources on which it depends, in order to function. You typically manually manage all these resource names and their locations within the application code. However, manual resource management becomes time consuming and error-prone as the number of dependent infrastructure resources increases or the number of microservices dynamically scale up and down based on traffic. You can also use third-party service discovery products, but this requires installing and managing additional software and infrastructure. 108 | 109 | Cloud Map allows you to register any application resources such as databases, queues, microservices, and other cloud resources with custom names. Cloud Map then constantly checks the health of resources to make sure the location is up-to-date. The application can then query the registry for the location of the resources needed based on the application version and deployment environment. 110 | 111 | ## Elastic Load Balancing 112 | 113 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/u1ayddlpka9jpc0jpvr3.png) 114 | 115 | Elastic Load Balancing (ELB) automatically distributes incoming application traffic across multiple targets, such as Amazon EC2 instances, containers, and IP addresses. It can handle the varying load of your application traffic in a single Availability Zone or across multiple Availability Zones. Elastic Load Balancing offers three types of load balancers that all feature the high availability, automatic scaling, and robust security necessary to make your applications fault tolerant. 116 | 117 | Application Load Balancer is best suited for load balancing of HTTP and HTTPS traffic and provides advanced request routing targeted at the delivery of modern application architectures, including microservices and containers. Operating at the individual request level (Layer 7), Application Load Balancer routes traffic to targets within Amazon Virtual Private Cloud (Amazon VPC) based on the content of the request. 118 | 119 | Network Load Balancer is best suited for load balancing of TCP traffic where extreme performance is required. Operating at the connection level (Layer 4), Network Load Balancer routes traffic to targets within Amazon Virtual Private Cloud (Amazon VPC) and is capable of handling millions of requests per second while maintaining ultra-low latencies. Network Load Balancer is also optimized to handle sudden and volatile traffic patterns. 120 | 121 | Classic Load Balancer provides basic load balancing across multiple Amazon EC2 instances and operates at both the request level and connection level. Classic Load Balancer is intended for applications that were built within the EC2-Classic network. 122 | 123 | # Conclusion 124 | 125 | A strong network setup is the foundation of any AWS environment. AWS networking help you quickly set up, secure, and monitor your network. AWS networking provide your traditional and modern applications with improved security, availability, performance, and streamlined monitoring. AWS networking provides secure and performant networking for user-facing application data. Deliver your data with single-digit millisecond latency. AWS networking helps create fast, secure, and reliable connections between your on-premises and AWS networks. 126 | 127 | ![2021-06-22 (2)](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/lbz5oamkzvlp7f136vph.png) 128 | 129 | 130 | Hope this guide helps you with the Introduction to Networking and Content Delivery with AWS, feel free to connect with me on [LinkedIn.](https://www.linkedin.com/in/adit-modi-2a4362191/) 131 | You can view my badges [here.](https://www.youracclaim.com/users/adit-modi/badges) 132 | If you are interested in learning more about AWS Services then follow me on [github.](https://github.com/AditModi) 133 | If you liked this content then do clap and share it . Thank You . -------------------------------------------------------------------------------- /Introduction to Security, Identity, and Compliance with AWS.md: -------------------------------------------------------------------------------- 1 | While companies increasingly look to cloud computing as a means to expand, modernize and stay competitive, so too do those companies expose themselves to new risks. In fact, Ermetic and IDC report that 80% of CISOs claim their company has had a cloud data breach in the past 18 months. Nearly half of those (43%) had experienced 10 or more breaches. 2 | 3 | The benefits of cloud computing are numerous, but organizations cannot make the switch to this modern platform without understanding the risks involved and, more importantly, how to protect themselves, their staff and their customers. 4 | 5 | Amazon Web Services (AWS) is a cloud service provider that’s on almost every company’s radar today. But many AWS customers today wonder what the best approach to security is and how to get there. 6 | 7 | companies often struggle to understand how they can protect and secure their data, their customers, and their very existence before moving to (or while expanding on) AWS. 8 | 9 | In this blog post, we will discuss some of the most important AWS security services that protect your data, accounts, and workloads from unauthorized access. 10 | 11 | ![Introduction to Developer Tools with AWS (2)](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/tzjc1a0bneocif3qol2i.png) 12 | 13 | *My Background: Cloud Engineer | AWS Community Builder | AWS Educate Cloud Ambassador | 4x AWS Certified | 3x OCI Certified | 3x Azure Certified.* 14 | 15 | The Introduction to AWS is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 16 | 17 | # Security, Identity, and Compliance 18 | 19 | Using AWS, you will gain the control and confidence you need to securely run your business with the most flexible and secure cloud computing environment available today. As an AWS customer, you will benefit from AWS data centers and a network architected to protect your information, identities, applications, and devices. With AWS, you can improve your ability to meet core security and compliance requirements, such as data locality, protection, and confidentiality with our comprehensive services and features. 20 | 21 | AWS allows you to automate manual security tasks so you can shift your focus to scaling and innovating your business. Plus, you pay only for the services that you use. All customers benefit from AWS being the only commercial cloud that has had its service offerings and associated supply chain vetted and accepted as secure enough for top-secret workloads. 22 | 23 | ## AWS Security Hub 24 | 25 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/889xibs9c607uns5own2.png) 26 | 27 | 28 | AWS Security Hub gives you a comprehensive view of your high-priority security alerts and compliance status across AWS accounts. 29 | 30 | There are a range of powerful security tools at your disposal, from firewalls and endpoint protection to vulnerability and compliance scanners. But oftentimes this leaves your team switching back-and-forth between these tools to deal with hundreds, and sometimes thousands, of security alerts every day. With Security Hub, you now have a single place that aggregates, organizes, and prioritizes your security alerts, or findings, from multiple AWS services, such as Amazon GuardDuty, Amazon Inspector, and Amazon Macie, as well as from AWS Partner solutions. 31 | 32 | Your findings are visually summarized on integrated dashboards with actionable graphs and tables. You can also continuously monitor your environment using automated compliance checks based on the AWS best practices and industry standards your organization follows. Get started with AWS Security Hub just a few clicks in the Management Console and once enabled, Security Hub will begin aggregating and prioritizing findings. 33 | 34 | ## Amazon Cloud Directory 35 | 36 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/6tkffqs1njeq2tbpdo38.png) 37 | 38 | 39 | Amazon Cloud Directory enables you to build flexible, cloud-native directories for organizing hierarchies of data along multiple dimensions. With Cloud Directory, you can create directories for a variety of use cases, such as organizational charts, course catalogs, and device registries. 40 | 41 | While traditional directory solutions, such as Active Directory Lightweight Directory Services (AD LDS) and other LDAP-based directories, limit you to a single hierarchy, Cloud Directory offers you the flexibility to create directories with hierarchies that span multiple dimensions. For example, you can create an organizational chart that can be navigated through separate hierarchies for reporting structure, location, and cost center. 42 | 43 | Amazon Cloud Directory automatically scales to hundreds of millions of objects and provides an extensible schema that can be shared with multiple applications. As a fully-managed service, Cloud Directory eliminates time-consuming and expensive administrative tasks, such as scaling infrastructure and managing servers. You simply define the schema, create a directory, and then populate your directory by making calls to the Cloud Directory API. 44 | 45 | ## AWS Identity and Access Management 46 | 47 | 48 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/xq2j403zyou516on07lg.png) 49 | 50 | 51 | AWS Identity and Access Management (IAM) enables you to securely control access to AWS services and resources for your users. Using IAM, you can create and manage AWS users and groups, and use permissions to allow and deny their access to AWS resources. IAM allows you to do the following: 52 | 53 | Manage IAM users and their access: You can create users in IAM, assign them individual security credentials (access keys, passwords, and multi-factor authentication devices), or request temporary security credentials to provide users access to AWS services and resources. You can manage permissions in order to control which operations a user can perform. 54 | 55 | Manage IAM roles and their permissions: You can create roles in IAM and manage permissions to control which operations can be performed by the entity, or AWS service, that assumes the role. You can also define which entity is allowed to assume the role. 56 | 57 | Manage federated users and their permissions: You can enable identity federation to allow existing identities (users, groups, and roles) in your enterprise to access the AWS Management Console, call AWS APIs, and access resources, without the need to create an IAM user for each identity. 58 | 59 | ## Amazon GuardDuty 60 | 61 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/x6raxo7c32spblqjigx3.png) 62 | 63 | Amazon GuardDuty is a threat detection service that continuously monitors for malicious or unauthorized behavior to help you protect your AWS accounts and workloads. It monitors for activity such as unusual API calls or potentially unauthorized deployments that indicate a possible account compromise. GuardDuty also detects potentially compromised instances or reconnaissance by attackers. 64 | 65 | Enabled with a few clicks in the AWS Management Console, Amazon GuardDuty can immediately begin analyzing billions of events across your AWS accounts for signs of risk. GuardDuty identifies suspected attackers through integrated threat intelligence feeds and uses machine learning to detect anomalies in account and workload activity. When a potential threat is detected, the service delivers a detailed security alert to the GuardDuty console and Amazon CloudWatch Events. This makes alerts actionable and easy to integrate into existing event management and workflow systems. 66 | 67 | Amazon GuardDuty is cost effective and easy. It does not require you to deploy and maintain software or security infrastructure, meaning it can be enabled quickly with no risk of negatively impacting existing application workloads. There are no upfront costs with GuardDuty, no software to deploy, and no threat intelligence feeds required. Customers pay for the events analyzed by GuardDuty and there is a 30-day free trial available for every new account to the service. 68 | 69 | ## Amazon Inspector 70 | 71 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/6r791sblh8pkg2r4e61h.png) 72 | 73 | Amazon Inspector is an automated security assessment service that helps improve the security and compliance of applications deployed on AWS. Amazon Inspector automatically assesses applications for exposure, vulnerabilities, and deviations from best practices. After performing an assessment, Amazon Inspector produces a detailed list of security findings prioritized by level of severity. These findings can be reviewed directly or as part of detailed assessment reports which are available via the Amazon Inspector console or API. 74 | 75 | Amazon Inspector security assessments help you check for unintended network accessibility of your Amazon EC2 instances and for vulnerabilities on those EC2 instances. Amazon Inspector assessments are offered to you as pre-defined rules packages mapped to common security best practices and vulnerability definitions. Examples of built-in rules include checking for access to your EC2 instances from the internet, remote root login being enabled, or vulnerable software versions installed. These rules are regularly updated by AWS security researchers. 76 | 77 | ## Amazon Macie 78 | 79 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/l85cbtps1ycl72zdvok8.png) 80 | 81 | Amazon Macie is a security service that uses machine learning to automatically discover, classify, and protect sensitive data in AWS. Amazon Macie recognizes sensitive data such as personally identifiable information (PII) or intellectual property, and provides you with dashboards and alerts that give visibility into how this data is being accessed or moved. The fully managed service continuously monitors data access activity for anomalies, and generates detailed alerts when it detects risk of unauthorized access or inadvertent data leaks. Today, Amazon Macie is available to protect data stored in Amazon S3, with support for additional AWS data stores coming later this year. 82 | 83 | ## AWS Artifact 84 | 85 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wjdopew82vny5li5vpro.png) 86 | 87 | AWS Artifact is your go-to, central resource for compliance-related information that matters to you. It provides on-demand access to AWS’ security and compliance reports and select online agreements. Reports available in AWS Artifact include our Service Organization Control (SOC) reports, Payment Card Industry (PCI) reports, and certifications from accreditation bodies across geographies and compliance verticals that validate the implementation and operating effectiveness of AWS security controls. Agreements available in AWS Artifact include the Business Associate Addendum (BAA) and the Nondisclosure Agreement (NDA). 88 | 89 | ## AWS Certificate Manager 90 | 91 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/s2qwx6t65qh1pdkq6g1r.png) 92 | 93 | AWS Certificate Manager is a service that lets you easily provision, manage, and deploy Secure Sockets Layer/Transport Layer Security (SSL/TLS) certificates for use with AWS services and your internal connected resources. SSL/TLS certificates are used to secure network communications and establish the identity of websites over the Internet as well as resources on private networks. AWS Certificate Manager removes the time-consuming manual process of purchasing, uploading, and renewing SSL/TLS certificates. 94 | 95 | With AWS Certificate Manager, you can quickly request a certificate, deploy it on ACM-integrated AWS resources, such as Elastic Load Balancing, Amazon CloudFront distributions, and APIs on API Gateway, and let AWS Certificate Manager handle certificate renewals. It also enables you to create private certificates for your internal resources and manage the certificate lifecycle centrally. Public and private certificates provisioned through AWS Certificate Manager for use with ACM-integrated services are free. You pay only for the AWS resources you create to run your application. With AWS Certificate Manager Private Certificate Authority, you pay monthly for the operation of the private CA and for the private certificates you issue. 96 | 97 | ## AWS CloudHSM 98 | 99 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/nda7h942yoe0n0z9ksug.png) 100 | 101 | The AWS CloudHSM is a cloud-based hardware security module (HSM) that enables you to easily generate and use your own encryption keys on the AWS Cloud. With CloudHSM, you can manage your own encryption keys using FIPS 140-2 Level 3 validated HSMs. CloudHSM offers you the flexibility to integrate with your applications using industry-standard APIs, such as PKCS#11, Java Cryptography Extensions (JCE), and Microsoft CryptoNG (CNG) libraries. 102 | 103 | CloudHSM is standards-compliant and enables you to export all of your keys to most other commercially-available HSMs, subject to your configurations. It is a fully-managed service that automates time-consuming administrative tasks for you, such as hardware provisioning, software patching, high-availability, and backups. CloudHSM also enables you to scale quickly by adding and removing HSM capacity on-demand, with no up-front costs. 104 | 105 | ## AWS Directory Service 106 | 107 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/6ufge1r5a7z1nuhwf80b.png) 108 | 109 | AWS Directory Service for Microsoft Active Directory, also known as AWS Managed Microsoft AD, enables your directory-aware workloads and AWS resources to use managed Active Directory in the AWS Cloud. AWS Managed Microsoft AD is built on actual Microsoft Active Directory and does not require you to synchronize or replicate data from your existing Active Directory to the cloud. You can use standard Active Directory administration tools and take advantage of built-in Active Directory features such as Group Policy and single sign-on (SSO). With AWS Managed Microsoft AD, you can easily join Amazon EC2 and Amazon RDS for SQL Server instances to a domain, and use AWS Enterprise IT applications such as Amazon WorkSpaces with Active Directory users and groups. 110 | 111 | ## AWS Firewall Manager 112 | 113 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/0xgknrtefv3sltz4lqaa.png) 114 | 115 | AWS Firewall Manager is a security management service that makes it easier to centrally configure and manage AWS WAF rules across your accounts and applications. Using Firewall Manager, you can easily roll out AWS WAF rules for your Application Load Balancers and Amazon CloudFront distributions across accounts in AWS Organizations. As new applications are created, Firewall Manager also makes it easy to bring new applications and resources into compliance with a common set of security rules from day one. Now you have a single service to build firewall rules, create security policies, and enforce them in a consistent, hierarchical manner across your entire Application Load Balancers and Amazon CloudFront infrastructure. 116 | 117 | ## AWS Key Management Service 118 | 119 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/4e7ipxdkapt48ygqs12k.png) 120 | 121 | AWS Key Management Service (KMS) makes it easy for you to create and manage keys and control the use of encryption across a wide range of AWS services and in your applications. AWS KMS is a secure and resilient service that uses FIPS 140-2 validated hardware security modules to protect your keys. AWS KMS is integrated with AWS CloudTrail to provide you with logs of all key usage to help meet your regulatory and compliance needs. 122 | 123 | 124 | ## AWS Secrets Manager 125 | 126 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/6oxotiztcccxyr7imyz2.png) 127 | 128 | 129 | AWS Secrets Manager helps you protect secrets needed to access your applications, services, and IT resources. The service enables you to easily rotate, manage, and retrieve database credentials, API keys, and other secrets throughout their lifecycle. Users and applications retrieve secrets with a call to Secrets Manager APIs, eliminating the need to hardcode sensitive information in plain text. Secrets Manager offers secret rotation with built-in integration for Amazon RDS for MySQL, PostgreSQL, and Amazon Aurora. Also, the service is extensible to other types of secrets, including API keys and OAuth tokens. In addition, Secrets Manager enables you to control access to secrets using fine-grained permissions and audit secret rotation centrally for resources in the AWS Cloud, third-party services, and on-premises. 130 | 131 | ## AWS Shield 132 | 133 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/jio6hk584xksrmmz4wuj.png) 134 | 135 | 136 | AWS Shield is a managed Distributed Denial of Service (DDoS) protection service that safeguards web applications running on AWS. AWS Shield provides always-on detection and automatic inline mitigations that minimize application downtime and latency, so there is no need to engage AWS Support to benefit from DDoS protection. There are two tiers of AWS Shield: Standard and Advanced. 137 | 138 | All AWS customers benefit from the automatic protections of AWS Shield Standard, at no additional charge. AWS Shield Standard defends against most common, frequently occurring network and transport layer DDoS attacks that target your website or applications. When you use AWS Shield Standard with Amazon CloudFront and Amazon Route 53, you receive comprehensive availability protection against all known infrastructure (Layer 3 and 4) attacks. 139 | 140 | For higher levels of protection against attacks targeting your applications running on Amazon Elastic Compute Cloud (Amazon EC2), Elastic Load Balancing (ELB), Amazon CloudFront, and Amazon Route 53 resources, you can subscribe to AWS Shield Advanced. In addition to the network and transport layer protections that come with Standard, AWS Shield Advanced provides additional detection and mitigation against large and sophisticated DDoS attacks, near real-time visibility into attacks, and integration with AWS WAF, a web application firewall. AWS Shield Advanced also gives you 24x7 access to the AWS DDoS Response Team (DRT) and protection against DDoS related spikes in your Amazon Elastic Compute Cloud (Amazon EC2), Elastic Load Balancing (ELB), Amazon CloudFront, and Amazon Route 53 charges. 141 | 142 | AWS Shield Advanced is available globally on all Amazon CloudFront and Amazon Route 53 edge locations. You can protect your web applications hosted anywhere in the world by deploying Amazon CloudFront in front of your application. Your origin servers can be Amazon S3, Amazon Elastic Compute Cloud (Amazon EC2), Elastic Load Balancing (ELB), or a custom server outside of AWS. You can also enable AWS Shield Advanced directly on an Elastic IP or Elastic Load Balancing (ELB) in the following AWS Regions: Northern Virginia, Oregon, Ireland, Tokyo, and Northern California. 143 | 144 | ## AWS Single Sign-On 145 | 146 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/qfobjd9b78rms2lbdvxv.png) 147 | 148 | AWS Single Sign-On (SSO) is a cloud SSO service that makes it easy to centrally manage SSO access to multiple AWS accounts and business applications. With just a few clicks, you can enable a highly available SSO service without the upfront investment and on-going maintenance costs of operating your own SSO infrastructure. With AWS SSO, you can easily manage SSO access and user permissions to all of your accounts in AWS Organizations centrally. AWS SSO also includes built-in SAML integrations to many business applications, such as Salesforce, Box, and Office 365. Further, by using the AWS SSO application configuration wizard, you can create Security Assertion Markup Language (SAML) 2.0 integrations and extend SSO access to any of your SAML-enabled applications. Your users simply sign in to a user portal with credentials they configure in AWS SSO or using their existing corporate credentials to access all their assigned accounts and applications from one place. 149 | 150 | ## AWS WAF 151 | 152 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/kww4zi9to51thz43s8zh.png) 153 | 154 | AWS WAF is a web application firewall that helps protect your web applications from common web exploits that could affect application availability, compromise security, or consume excessive resources. AWS WAF gives you control over which traffic to allow or block to your web application by defining customizable web security rules. You can use AWS WAF to create custom rules that block common attack patterns, such as SQL injection or cross-site scripting, and rules that are designed for your specific application. New rules can be deployed within minutes, letting you respond quickly to changing traffic patterns. Also, AWS WAF includes a full-featured API that you can use to automate the creation, deployment, and maintenance of web security rules. 155 | 156 | ## AWS Organizations 157 | 158 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/rfovnz2mp7lh0trbogd8.png) 159 | 160 | AWS Organizations offers policy-based management for multiple AWS accounts. With Organizations, you can create groups of accounts, automate account creation, apply and manage policies for those groups. Organizations enables you to centrally manage policies across multiple accounts, without requiring custom scripts and manual processes. 161 | 162 | Using AWS Organizations, you can create Service Control Policies (SCPs) that centrally control AWS service use across multiple AWS accounts. You can also use Organizations to help automate the creation of new accounts through APIs. Organizations helps simplify the billing for multiple accounts by enabling you to setup a single payment method for all the accounts in your organization through consolidated billing. AWS Organizations is available to all AWS customers at no additional charge. 163 | 164 | 165 | # Conclusion 166 | 167 | AWS provides services that help you protect your data, accounts, and workloads from unauthorized access. AWS provide encryption and key management and threat detection that continuously monitors and protects your accounts and workloads. 168 | AWS identifies threats by continuously monitoring the network activity and account behavior within your cloud environment. 169 | AWS gives you a comprehensive view of your compliance status and continuously monitors your environment using automated compliance checks based on the AWS best practices and industry standards your organization follows. 170 | 171 | ![2021-06-22 (1)](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/1kqmaghkoz2a35z36q3w.png) 172 | 173 | 174 | Hope this guide helps you with the Introduction to Security, Identity, and Compliance with AWS, feel free to connect with me on [LinkedIn] (https://www.linkedin.com/in/adit-modi-2a4362191/)|[Twitter](https://twitter.com/adi_12_modi). 175 | If you are interested in learning more about AWS Services then follow me on [github.](https://github.com/AditModi) 176 | If you liked this content then do clap and share it . Thank You . -------------------------------------------------------------------------------- /Introduction to Serverless with AWS.md: -------------------------------------------------------------------------------- 1 | **The serverless computing model** allows you to build and run applications and services without having to worry about infrastructure or servers. It eliminates infrastructure management tasks such as server provisioning, patching, operating system maintenance, scaling, and capacity provisioning. 2 | 3 | In this blogpost, I would like to give you an overview of some fully-managed serverless services provided by Amazon Web Services (AWS), which can be used to create fully cloud-native serverless applications. 4 | 5 | Building native serverless applications means that developers can focus on the **core product** and on **innovating applications and solutions**, rather than spending a lot of time on setting up and maintaining infrastructure. This results in many benefits such as faster development, simplified operational management, scaling, and reduction in operational costs. Take a look at my last blogpost to get an impression on serverless architectures and how they impact the development process and the project business. 6 | 7 | But how can we actually implement these serverless applications? What tools and services should I use to create a highly-available, scalable and performant backend solution? How can I benefit from managed infrastructure, variable operational costs that scale with my business? How can I increase speed and agility in my development process? 8 | 9 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/hvpqein4enwo53ft7geo.png) 10 | 11 | 12 | 13 | *My Background: I am Cloud , DevOps & Big Data Enthusiast | 4x AWS Certified | 3x OCI Certified | 3x Azure Certified .* 14 | 15 | The Introduction to AWS is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 16 | 17 | 18 | AWS provides a wide range of different cloud services (>165) which cover all aspects and requirements of backend solutions, like compute resources, different storage types, purpose-built databases, security services for authentication and encryption, big data stream processing, machine learning, messaging and monitoring services, and many more. 19 | 20 | These services are tightly integrated with each other and provide a convenient way to build your application in a flexible and powerful way. This blogpost will give you an overview of the most important serverless services of AWS. 21 | 22 | An overview of serverless AWS services 23 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/c203zd5t2tg8t8hxhs4w.png) 24 | 25 | 26 | 27 | Compute provides you with the execution environment for your application code. 28 | 29 | [**With AWS Lambda**](https://aws.amazon.com/lambda/), you can execute code as a function triggered by various event sources like, e.g., HTTP requests on AWS API Gateway, file updates on S3, or metric alarms in AWS Cloudwatch. Lambda is the FaaS solution from AWS where you can run code for any type of application or backend service. It runs the code on a fully-managed, high-available infrastructure and performs all administration tasks of the compute resources, including server and system maintenance, capacity provisioning and automatic scaling, code monitoring and logging. You pay only for the compute time your application actually consumes. Lambda can be combined with many other AWS services and is used in many scenarios, like authorizing a HTTP request by validating a JSON web token, real-time filtering and transforming streaming data, processing data in S3, managing database handling, and many more. 30 | 31 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/hwceran5uneaz0pumash.png) 32 | 33 | 34 | [**With AWS Fargate**](https://aws.amazon.com/fargate/), you can run docker containers without any management of servers or clusters. It is a container orchestration solution that makes it easy to deploy, manage, and scale containerized applications. You don’t need to define EC2 instance types, manage cluster scheduling, optimize server utilization, or define cloud watch metrics to scale the instances. Fargate manages the infrastructure needed to run your containers in a highly-available manner. To launch your application, you need to package your containers, specify CPU and memory requirements, and define networking and IAM policies. 35 | 36 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/g0e5lbkv748iy4o0p62g.png) 37 | 38 | 39 | ## Messaging 40 | 41 | 42 | 43 | [**AWS Simple Notification Service (SNS)**](https://aws.amazon.com/sns/) is a fully-managed pub/sub messaging service that enables you to decouple microservices, distributed systems, and serverless applications. 44 | 45 | You can send notifications between various services, applications, devices and platforms over multiple transport protocols. SNS allows you to publish messages from one application to a large number of subscribers for parallel processing. Besides push notifications to mobile devices, you can deliver notifications by email, SMS, SQS, Lambda, or to any HTTP endpoint. 46 | 47 | [**Amazon Simple Queue Service (SQS)**](https://aws.amazon.com/sqs/) is a fully-managed distributed message queueing service that enables you to decouple and scale microservice distributed systems and serverless applications. You can send, receive and cache messages between software components to resolve issues introduced by the producer-consumer problem. SQS offers two types of message queues: Standard queues have maximum throughput, best-effort ordering, and at-least-once delivery. Additionally, you can use FIFO queues, which guarantee exactly-once message delivery with strict order. 48 | 49 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/mrzonqlyon7785xhgvuu.png) 50 | 51 | ## Integration 52 | 53 | [**Amazon API Gateway**](https://aws.amazon.com/api-gateway/) is a fully-managed service for creating, publishing, maintaining, monitoring, and securing REST and WebSocket APIs at any scale. It handles the processing of up to hundreds of thousands concurrent API calls, including traffic management, authorization, access control, and API version management. You can create your API within the management console UI and access data, business logic, or functionality from your backend services, such as workloads running on EC2 or code running in a Lambda function. You pay only for the API calls you receive and for the amount of outgoing data, transmitted by AWS. 54 | 55 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/kycb7vn7qec37ztljgs9.png) 56 | 57 | 58 | [**With AWS Step Functions**](https://aws.amazon.com/step-functions/), you can orchestrate the components of your application as a series of steps to create complex serverless workflows using Lambda functions. The workflow is modeled as a state machine diagram, where each state represents a component of the application. Using a graphical viewer, you can visualize these components and check the execution flow in real time. All steps are automatically triggered, tracked and retried in case of errors, so that the application executes in order and as expected. 59 | 60 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/sn035wgssqedzkoc0ks5.png) 61 | 62 | 63 | ## Security 64 | 65 | [**Amazon Cognito**](https://aws.amazon.com/cognito/) is a fully-managed, scalable, and cost-effective sign-up/sign-in service, which provides user authentication, authorization, and management for web and mobile applications. The two main components of Amazon Cognito are user pools and identity pools. A user pool is a user directory, which provides sign-up and sign-in services, based on its own or an external identity provider that implements the SAML, OAuth2, or OpenID Connect protocol, like Facebook or Google. You can use a customizable web UI for the user sign-in, which can be integrated in your existing webpage. With an identity pool, your authorized user or anonymous guest can exchange user pool tokens for temporary AWS credentials to access AWS resources. Based on IAM role policies, you can grant your users or groups fine-grained access to your resources or AWS services. Cognito has advanced security features, such as e-mail, phone verification, and multi-factor authentication. 66 | 67 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/5quvwkwv76exxx1vwee0.png) 68 | 69 | 70 | [**AWS Key Management Service (KMS)**](https://aws.amazon.com/kms/) is a fully-managed service which allows you to create and manage your security keys and control the use of encryption across a wide range of AWS services and in your applications. KMS is integrated with many AWS services to simplify encryption handling across your application. It enables developers to easily add encryption functionality to the application, either directly through the service APIs or with the AWS Encryption SDK. Customer master keys (CMK) are used to control access to data encryption keys that encrypt and decrypt the data. You can provide and manage your own CMK including your custom cryptographic material or using a CMK provided and managed by AWS. 71 | 72 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/9b51zh3cxweazt7damji.png) 73 | 74 | 75 | [**With AWS CloudHSM**](https://aws.amazon.com/cloudhsm/) you can additionally use a cloud-based hardware security module (HSM) that enables you to easily generate and use your own encryption keys on the AWS Cloud. The encryption keys that you generate and use with CloudHSM are accessible only by the HSM users that you specify. AWS has no visibility or access to your encryption keys. 76 | 77 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/or6fk33k9vrvor7swsz1.png) 78 | 79 | 80 | ## Monitoring 81 | 82 | [**AWS CloudWatch**](https://aws.amazon.com/cloudwatch/) is a monitoring and management service for AWS resources and custom applications. CloudWatch enables you to collect metrics and logs from all your AWS resources, applications, and services that run on AWS and on-premises servers. It provides real-time monitoring and visibility into resource utilization of your EC2 instances, your applications’ performance, and operational health. CloudWatch is natively integrated with many AWS services that can publish detailed metrics with up to 1 second granularity. Additionally, you can define alarms based on CloudWatch metrics and perform actions based on its value. You can, e.g., set a threshold on a key utilization metrics and trigger an automated auto scaling action to add or remove EC2 instances. 83 | 84 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/ov61p7hwbr6z4umzv890.png) 85 | 86 | 87 | [**AWS Quicksight**](https://aws.amazon.com/quicksight/) is a fully-managed business intelligence service, which allows you to create visualisations of data and to design interactive dashboards for application analysis. These dashboards can be accessed from any mobile device or browser. You can embed them into your applications, portals or websites, providing you with powerful self-service analytics. QuickSight allows you to connect to and import data from a wide variety of cloud or on-premises data sources and scales to tens of thousands of users without any infrastructure to manage. 88 | 89 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/3mrxyl7k798r4qiatcsk.png) 90 | 91 | 92 | ## Database 93 | 94 | [**Amazon DynamoDB**](https://aws.amazon.com/dynamodb/) is a NoSQL database service which supports key-value pairs and document data structures. As it is a fully-managed service, you don’t have to worry about hardware provisioning, setup and configuration, replication, backups, software patching, or cluster scaling. It provides features like high availability and durability, automatic and infinite read-write I/O scaling, on demand backup with point-in-time recovery, encryption at rest, and single-digit millisecond latency. With its pay-per-use pricing model and integration with many other AWS services, DynamoDB is a great database service for many serverless application on AWS. 95 | 96 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/yi1gg5sn8a4j9l6ejmqz.png) 97 | 98 | 99 | [**Amazon Aurora**](https://aws.amazon.com/rds/aurora/) is a fully-managed relational database engine that’s compatible with MySQL and PostgreSQL. It automates and standardizes database clustering and replication to remove time-consuming administration tasks, like hardware provisioning, storage autoscaling, database setup, patching, and backups. Aurora is also available as an on-demand configuration, called Aurora Serverless, with autoscaling for compute capacity, which is a cost-effective way to support infrequent and unpredictable workloads. 100 | 101 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/racs5myh1gzb9n0b1w00.png) 102 | 103 | 104 | ## Analytics 105 | 106 | [**Amazon Kinesis**](https://aws.amazon.com/kinesis/) is a is fully-managed and highly scalable streaming service to collect, process, and analyze real-time streaming data, such as website clickstreams, database event streams, financial transactions, social media feeds, application logs, IoT telemetry data, or location-tracking events. It enables you to process and analyze data as it arrives and to respond instantly, so that you can create real-time applications. Amazon Kinesis consists of 3 services, which can be used to process the streaming data. **With Amazon Kinesis Data Streams**, you can ingest and store large data streams in real-time without managing the infrastructure, storage, networking, and configuration. Applications can consume data from a stream, so that multiple actions, like data analysis, archiving, or processing, can take place concurrently and independently. **Amazon Kinesis Data Firehose** can be used to load streaming data into data lakes (Amazon Redshift), data stores (S3), and analytics tools (Amazon Elasticsearch). It allows you to to capture, transform, and load (ETL) streaming data in real-time from many data sources simultaneously and send it automatically to the specified destination. **With Amazon Kinesis Data Analytics** you can filter, aggregate, and transform streaming data for advanced analytics. You can run standard SQL queries against streaming data to perform time series analytics, provide data to real-time dashboards, and extract metrics. 107 | 108 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/xrb43or6xwscgoyfvq7s.png) 109 | 110 | 111 | [**Amazon Athena**](https://www.amazonaws.cn/en/athena/) is a query service which provides a standard SQL language to analyze large-scale datasets in AWS Simple Storage Service (S3). There is no infrastructure to manage, and you pay only for the executed queries. Athena scales automatically by executing queries in parallel. This makes it simple to do ad-hoc analysis or more complex analysis that contain large joins. 112 | 113 | ![image](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/najg3g9bk3ypns8dxl1e.png) 114 | 115 | 116 | ## Conclusion 117 | 118 | AWS provides many services which can be used as building blocks to create cloud infrastructures for virtually any workload. Solution architects and developers have a huge range of tools and services to design and implement backend applications in a very effective way with great flexibility. 119 | 120 | Most services provided by AWS are fully-managed and can be used without time-consuming administrative tasks, infrastructure provisioning or server maintenance. Developers can focus on creating their core applications, which increases development speed and business growth. Important aspects like high availability, automatic scalability, security, and durability are built in. 121 | 122 | This is a huge advantage compared to using open-source services hosted on manually provisioned server infrastructures. With the pay-as-you-go pricing model you have no upfront costs or long-term contracts and pay only for the consumed resources, which makes serverless architectures very cost effective. 123 | 124 | Hope this guide helps you with the Introduction to Serverless with AWS, feel free to connect with me on [LinkedIn.](https://www.linkedin.com/in/adit-modi-2a4362191/) 125 | You can view my badges [here.](https://www.youracclaim.com/users/adit-modi/badges) 126 | If you are interested in learning more about AWS then follow me on [github.](https://github.com/AditModi) 127 | If you liked this content then do clap and share it . Thank You . -------------------------------------------------------------------------------- /Introduction to Storage with AWS.md: -------------------------------------------------------------------------------- 1 | * Although legacy storage players are tired of talking about cloud’s impact on their business, the reality cannot be ignored. Cloud has been the most disruptive force in storage over the past 10 years. But drilling down into the cloud, AWS has been the most significant factor. S3 came out in 2006 as the very first AWS service. From there on the storage business as we know it has changed forever. 2 | 3 | * Millions of customers use AWS storage services to transform their business, increase agility, reduce costs, and accelerate innovation. AWS supports broad portfolio of storage solutions with deep functionality for storing, accessing, protecting, and analyzing your data. 4 | 5 | * In this blog post, we will discuss some of the most important AWS Storage services and How to provide reliable, scalable, and secure storage for your data. 6 | 7 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/2f7g4mu83ib72blfrkv4.png) 8 | 9 | > **The Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 10 | 11 | # AWS Storage Services 12 | 13 | * AWS storage services are low-cost data storage with high durability and high availability. You also get the option to backing up information, archiving, and disaster recovery. These Storage services are widely used for migrating applications, building data lakes and modernizing application development among other use-cases. 14 | 15 | ## Amazon Elastic Block Store 16 | 17 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/tqmiofexk5ku4cnijqch.png) 18 | 19 | * Amazon Elastic Block Store (Amazon EBS) provides persistent block storage volumes for use with Amazon EC2 instances in the AWS Cloud. Each Amazon EBS volume is automatically replicated within its Availability Zone to protect you from component failure, offering high availability and durability. 20 | 21 | * Amazon EBS volumes offer the consistent and low-latency performance needed to run your workloads. With Amazon EBS, you can scale your usage up or down within minutes—all while paying a low price for only what you provision. 22 | 23 | ## Amazon Elastic File System 24 | 25 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/6wzim2ebkl4lyczztuux.png) 26 | 27 | * Amazon Elastic File System (Amazon EFS) provides a simple, scalable, elastic file system for Linux-based workloads for use with AWS Cloud services and on-premises resources. 28 | 29 | * It is built to scale on demand to petabytes without disrupting applications, growing and shrinking automatically as you add and remove files, so your applications have the storage they need – when they need it. 30 | 31 | * It is designed to provide massively parallel shared access to thousands of Amazon EC2 instances, enabling your applications to achieve high levels of aggregate throughput and IOPS with consistent low latencies. 32 | 33 | * Amazon EFS is a fully managed service that requires no changes to your existing applications and tools, providing access through a standard file system interface for seamless integration. 34 | 35 | * Amazon EFS is a regional service storing data within and across multiple Availability Zones (AZs) for high availability and durability. You can access your file systems across AZs and AWS Regions and share files between thousands of Amazon EC2 instances and on-premises servers via AWS Direct Connect or AWS VPN. 36 | 37 | * Amazon EFS is well suited to support a broad spectrum of use cases from highly parallelized, scale-out workloads that require the highest possible throughput to single-threaded, latency-sensitive workloads. 38 | 39 | * Use cases such as lift-and-shift enterprise applications, big data analytics, web serving and content management, application development and testing, media and entertainment workflows, database backups, and container storage. 40 | 41 | ##Amazon FSx for Lustre 42 | 43 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/1lh1ul6uoa0neqmwee2f.png) 44 | 45 | * Amazon FSx for Lustre is a fully managed file system that is optimized for compute-intensive workloads, such as high performance computing, machine learning, and media data processing workflows. 46 | 47 | * Many of these applications require the high-performance and low latencies of scale-out, parallel file systems. Operating these file systems typically requires specialized expertise and administrative overhead, requiring you to provision storage servers and tune complex performance parameters. 48 | 49 | * With Amazon FSx, you can launch and run a Lustre file system that can process massive data sets at up to hundreds of gigabytes per second of throughput, millions of IOPS, and sub-millisecond latencies. 50 | 51 | * Amazon FSx for Lustre is seamlessly integrated with Amazon S3, making it easy to link your long-term data sets with your high performance file systems to run compute-intensive workloads. 52 | 53 | * You can automatically copy data from S3 to FSx for Lustre, run your workloads, and then write results back to S3. FSx for Lustre also enables you to burst your compute-intensive workloads from on-premises to AWS by allowing you to access your FSx file system over Amazon Direct Connect or VPN. 54 | 55 | * FSx for Lustre helps you cost-optimize your storage for compute-intensive workloads: It provides cheap and performant non-replicated storage for processing data, with your long-term data stored durably in Amazon S3 or other low-cost data stores. 56 | 57 | * With Amazon FSx, you pay for only the resources you use. There are no minimum commitments, upfront hardware or software costs, or additional fees. 58 | 59 | ## Amazon FSx for Windows File Server 60 | 61 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/gf2bcs3da5htlul1lmz7.png) 62 | 63 | * Amazon FSx for Windows File Server provides a fully managed native Microsoft Windows file system so you can easily move your Windows-based applications that require file storage to AWS. 64 | 65 | * Built on Windows Server, Amazon FSx provides shared file storage with the compatibility and features that your Windows-based applications rely on, including full support for the SMB protocol and Windows NTFS, Active Directory (AD) integration, and Distributed File System (DFS). 66 | 67 | * Amazon FSx uses SSD storage to provide the fast performance your Windows applications and users expect, with high levels of throughput and IOPS, and consistent sub-millisecond latencies. This compatibility and performance is particularly important when moving workloads that require Windows shared file storage, like CRM, ERP, and .NET applications, as well as home directories. 68 | 69 | * With Amazon FSx, you can launch highly durable and available Windows file systems that can be accessed from up to thousands of compute instances using the industry-standard SMB protocol. 70 | 71 | * Amazon FSx eliminates the typical administrative overhead of managing Windows file servers. You pay for only the resources used, with no upfront costs, minimum commitments, or additional fees. 72 | 73 | ## Amazon Simple Storage Service 74 | 75 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/zvsx56eox994dqgplg52.png) 76 | 77 | * Amazon Simple Storage Service (Amazon S3) is an object storage service that offers industry-leading scalability, data availability, security, and performance. 78 | 79 | * This means customers of all sizes and industries can use it to store and protect any amount of data for a range of use cases, such as websites, mobile applications, backup and restore, archive, enterprise applications, IoT devices, and big data analytics. 80 | 81 | * Amazon S3 provides easy-to-use management features so you can organize your data and configure finely-tuned access controls to meet your specific business, organizational, and compliance requirements. Amazon S3 is designed for 99.999999999% (11 9's) of durability, and stores data for millions of applications for companies all around the world. 82 | 83 | ## Amazon S3 Glacier 84 | 85 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/i3y12m1s2fy7w6yvxb77.png) 86 | 87 | * Amazon S3 Glacier is a secure, durable, and extremely low-cost storage service for data archiving and long-term backup. It is designed to deliver 99.999999999% durability, and provides comprehensive security and compliance capabilities that can help meet even the most stringent regulatory requirements. 88 | 89 | * Amazon S3 Glacier provides query-in-place functionality, allowing you to run powerful analytics directly on your archive data at rest. You can store data for as little as $1 per terabyte per month, a significant savings compared to on-premises solutions. 90 | 91 | * To keep costs low yet suitable for varying retrieval needs, Amazon S3 Glacier provides three options for access to archives, from a few minutes to several hours, and S3 Glacier Deep Archive provides two access options ranging from 12 to 48 hours. 92 | 93 | ## AWS Backup 94 | 95 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/wiznfyip03krgncrcgaj.png) 96 | 97 | * AWS Backup enables you to centralize and automate data protection across AWS services. AWS Backup offers a cost-effective, fully managed, policy-based service that further simplifies data protection at scale. 98 | 99 | * AWS Backup also helps you support your regulatory compliance or business policies for data protection. Together with AWS Organizations, AWS Backup enables you to centrally deploy data protection policies to configure, manage, and govern your backup activity across your organization’s AWS accounts and resources, including Amazon Elastic Compute Cloud (Amazon EC2) instances, Amazon Elastic Block Store (Amazon EBS) volumes, Amazon Relational Database Service (Amazon RDS) databases (including Amazon Aurora clusters), Amazon DynamoDB tables, Amazon Elastic File System (Amazon EFS) file systems, Amazon FSx for Lustre file systems, Amazon FSx for Windows File Server file systems, and AWS Storage Gateway volumes. 100 | 101 | ## Storage Gateway 102 | 103 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/uqz6qcoe09db9sdjql42.png) 104 | 105 | * The Storage Gateway is a hybrid storage service that enables your on-premises applications to seamlessly use AWS cloud storage. You can use the service for backup and archiving, disaster recovery, cloud data processing, storage tiering, and migration. 106 | 107 | * Your applications connect to the service through a virtual machine or hardware gateway appliance using standard storage protocols, such as NFS, SMB and iSCSI. The gateway connects to AWS storage services, such as Amazon S3, S3 Glacier, and Amazon EBS, providing storage for files, volumes, and virtual tapes in AWS. The service includes a highly-optimized data transfer mechanism, with bandwidth management, automated network resilience, and efficient data transfer, along with a local cache for low-latency on-premises access to your most active data. 108 | 109 | ![Image description](https://dev-to-uploads.s3.amazonaws.com/uploads/articles/82sllpcwzet8mzebhf51.png) 110 | 111 | # Conclusion 112 | 113 | * AWS storage services help companies extend secondary storage targets to the cloud to address exponential data growth. Meet long-term retention requirements with AWS storage services. Optimizing their storage costs based on how frequently and quickly they need to access their data. 114 | 115 | * these services also provide security, reliability, unlimited scalability and durability. AWS supports security standards and compliance certifications for these services to help customers satisfy requirements for virtually every regulatory agency around the globe. 116 | 117 | 118 | Hope this guide helps you with the Introduction to Storage with AWS. 119 | 120 | Let me know your thoughts in the comment section 👇 121 | And if you haven't yet, make sure to follow me on below handles: 122 | 123 | 👋 **connect with me on [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/)** 124 | 🤓 **connect with me on [Twitter](https://twitter.com/adi_12_modi)** 125 | 🐱‍💻 **follow me on [github](https://github.com/AditModi)** 126 | ✍️ **Do Checkout [my blogs](https://aditmodi.hashnode.dev)** 127 | 128 | Like, share and follow me 🚀 for more content. 129 | 130 | {% user aditmodi %} -------------------------------------------------------------------------------- /README.md: -------------------------------------------------------------------------------- 1 | # Introduction-to-AWS-Topics 2 | 3 | The **Introduction to AWS** is a Series containing different articles that provide a basic introduction to different aws topics/categories. Each article covers the detailed guide on how to work with particular topic/category . This series aims at providing "A Getting Started Guide on Different aws topics / categories ." 4 | 5 | Feel free to make suggestions, I am open to any advice! You can reach me on [Twitter](https://twitter.com/adi_12_modi) or [LinkedIn](https://www.linkedin.com/in/adit-modi-2a4362191/). 6 | 7 | ##### Enjoy! 😉👍 8 | 9 | ![visitors](https://visitor-badge.glitch.me/badge?page_id=/AditModi/Introduction-to-AWS-Topics)[![Website](https://img.shields.io/website?label=Dev.to&up_message=@aditmodi&url=https%3A%2F%2Fdev.to/aditmodi)](https://dev.to/aditmodi) 10 | 11 | ![Introduction to AWS](https://user-images.githubusercontent.com/48589838/177519114-c128fa9b-1a45-481a-993e-bb47dae227c0.jpg) 12 | 13 | 14 | | | Topic | Personal Website | Hashnode | 15 | | ------------ | ------------ | ---------------- | ------------ | 16 | | 1 | Introduction to **Containers with AWS** |[ Link ]() |[ Hashnode ]() 17 | | 2 | Introduction to **Serverless with AWS** |[ Link ]() |[ Hashnode ]() 18 | | 3 | Introduction to **Game Tech with AWS** |[ Link ]() |[ Hashnode ]() 19 | | 4 | Introduction to **Developer Tools with AWS** |[ Link ]() |[ Hashnode ]() 20 | | 5 | Introduction to **Containers with AWS** |[ Link ]() |[ Hashnode ]() 21 | | 6 | Introduction to **Security, Identity, and Compliance with AWS** |[ Link ]() |[ Hashnode ]() 22 | | 7 | Introduction to **Networking and Content Delivery with AWS** |[ Link ]() |[ Hashnode ]() 23 | | 8 | Introduction to **Data (Databases, Analytics, Blockchain) with AWS - Part 1** |[ Link ]() |[ Hashnode ]() 24 | | 9 | Introduction to **Data (Databases, Analytics, Blockchain) with AWS - Part 2** |[ Link ]() |[ Hashnode ]() 25 | | 10 | Introduction to **Mobile and Web Apps with AWS** |[ Link ]() |[ Hashnode ]() 26 | | 11 | Introduction to **Storage with AWS** |[ Link ]() |[ Hashnode ]() 27 | | 12 | Introduction to **Management, Governance and Migration with AWS - Part 1** |[ Link ]() |[ Hashnode ]() 28 | | 13 | Introduction to **Management, Governance and Migration with AWS - Part 2** |[ Link ]() |[ Hashnode ]() 29 | | 14 | Introduction to **Machine Learning with AWS - Part 1** |[ Link ]() |[ Hashnode ]() 30 | | 15 | Introduction to **Machine Learning with AWS - Part 2** |[ Link ]() |[ Hashnode ]() 31 | | 16 | Introduction to **Machine Learning with AWS - Part 3** |[ Link ]() |[ Hashnode ]() 32 | --------------------------------------------------------------------------------