Introduction to Serverless with AWS
The serverless computing model allows developers to create and operate applications and services without the need to manage infrastructure or servers. This eliminates tasks such as provisioning servers, patching, operating system maintenance, scaling, and capacity provisioning.
In this article, an overview is given of some fully-managed serverless services provided by Amazon Web Services (AWS), which can be utilized to develop fully cloud-native serverless applications. Creating native serverless applications means that developers can concentrate on the core product and on developing new applications and solutions, rather than dedicating a lot of time to setting up and maintaining infrastructure. This leads to numerous benefits such as faster development, streamlined operational management, scaling, and cost reduction.
However, the question remains, how can we put these serverless applications into practice? What tools and services should be used to create a highly available, scalable, and high-performance back-end solution? How can we take advantage of managed infrastructure and variable operational costs that adapt to the growth of our business? How can we increase speed and agility in our development process?
My Background: I am Cloud, DevOps, MlOps, Quantum, AI, ML & Big Data Enthusiast | 1x Azure Certified.
The AWS Introduction series is a collection of articles that offer a foundational understanding of various AWS topics and categories. Each piece provides a comprehensive guide on how to work with a specific topic or category. The goal of this series is to serve as a beginner’s guide for different AWS topics and categories, providing step-by-step instructions for getting started.
Amazon Web Services offers a vast array of cloud services, exceeding 165, that cater to the diverse needs of backend solutions. These services include various types of compute resources, storage options, specialized databases, security services for authentication and encryption, big data stream processing, machine learning, messaging, and monitoring services, and many more.
These services are seamlessly integrated, providing an effortless way to construct your application in a robust and adaptable manner. In this blog post, a summary of the key serverless services provided by AWS will be presented.
An overview of serverless AWS services execution environment for your application code is provided by the Compute service.
AWS Lambda
- With AWS Lambda, you can execute code as a function triggered by various event sources such as:
- HTTP requests on AWS API Gateway
- File updates on S3
- Metric alarms in AWS CloudWatch
- Lambda is the FaaS (Function as a Service) solution from AWS, that can be utilized for any type of application or backend service.
- It runs the code on a fully-managed, highly available infrastructure and handles all administrative tasks of the compute resources, including server and system maintenance, capacity provisioning and automatic scaling, code monitoring, and logging.
- You only pay for the compute time your application actually consumes.
- Lambda can be combined with many other AWS services, and is used in various scenarios such as:
- Authorizing HTTP requests by validating a JSON web token
- Real-time filtering and transforming streaming data
- Processing data in S3
- Managing database handling And many more.
With AWS Fargate, you can run docker containers without any management of servers or clusters. It is a container orchestration solution that makes it easy to deploy, manage, and scale containerized applications. You don’t need to define EC2 instance types, manage cluster scheduling, optimize server utilization, or define cloud watch metrics to scale the instances. Fargate manages the infrastructure needed to run your containers in a highly-available manner. To launch your application, you need to package your containers, specify CPU and memory requirements, and define networking and IAM policies.
Messaging
AWS Simple Notification Service (SNS) SNS is a fully managed pub/sub messaging service that enables you to decouple microservices, distributed systems, and serverless applications.
You can send notifications between various services, applications, devices, and platforms over multiple transport protocols. SNS allows you to publish messages from one application to a large number of subscribers for parallel processing. Besides push notifications to mobile devices, you can deliver notifications by email, SMS, SQS, Lambda, or to any HTTP endpoint.
Amazon Simple Queue Service (SQS) SQS is a fully-managed distributed message queueing service that enables you to decouple and scale microservice distributed systems and serverless applications. You can send, receive and cache messages between software components to resolve issues introduced by the producer-consumer problem. SQS offers two types of message queues: Standard queues have maximum throughput, best-effort ordering, and at-least-once delivery. Additionally, you can use FIFO queues, which guarantee exactly-once message delivery with strict orders.
Integration
Amazon API Gateway is a fully-managed service for creating, publishing, maintaining, monitoring, and securing REST and WebSocket APIs at any scale. It handles the processing of up to hundreds of thousands of concurrent API calls, including traffic management, authorization, access control, and API version management. You can create your API within the management console UI and access data, business logic, or functionality from your backend services, such as workloads running on EC2 or code running in a Lambda function. You pay only for the API calls you receive and for the amount of outgoing data, transmitted by AWS.
With AWS Step Functions, you can orchestrate the components of your application as a series of steps to create complex serverless workflows using Lambda functions. The workflow is modeled as a state machine diagram, where each state represents a component of the application. Using a graphical viewer, you can visualize these components and check the execution flow in real-time. All steps are automatically triggered, tracked, and retried in case of errors so that the application executes in order and as expected.
Security
Amazon Cognito is a fully-managed, scalable, and cost-effective sign-up/sign-in service, which provides user authentication, authorization, and management for web and mobile applications. The two main components of Amazon Cognito are user pools and identity pools. A user pool is a user directory, which provides sign-up and sign-in services, based on its own or an external identity provider that implements the SAML, OAuth2, or OpenID Connect protocol, like Facebook or Google. You can use a customizable web UI for the user sign-in, which can be integrated into your existing webpage. With an identity pool, your authorized user or anonymous guest can exchange user pool tokens for temporary AWS credentials to access AWS resources. Based on IAM role policies, you can grant your users or groups fine-grained access to your resources or AWS services. Cognito has advanced security features, such as e-mail, phone verification, and multi-factor authentication.
AWS Key Management Service (KMS) is a fully-managed service that allows you to create and manage your security keys and control the use of encryption across a wide range of AWS services and in your applications. KMS is integrated with many AWS services to simplify encryption handling across your application. It enables developers to easily add encryption functionality to the application, either directly through the service APIs or with the AWS Encryption SDK. Customer master keys (CMK) are used to control access to data encryption keys that encrypt and decrypt the data. You can provide and manage your own CMK including your custom cryptographic material or use a CMK provided and managed by AWS.
With AWS CloudHSM you can additionally use a cloud-based hardware security module (HSM) that enables you to easily generate and use your own encryption keys on the AWS Cloud. The encryption keys that you generate and use with CloudHSM are accessible only by the HSM users that you specify. AWS has no visibility or access to your encryption keys.
Monitoring
AWS CloudWatch is a monitoring and management service for AWS resources and custom applications. CloudWatch enables you to collect metrics and logs from all your AWS resources, applications, and services that run on AWS and on-premises servers. It provides real-time monitoring and visibility into resource utilization of your EC2 instances, your applications’ performance, and operational health. CloudWatch is natively integrated with many AWS services that can publish detailed metrics with up to 1-second granularity. Additionally, you can define alarms based on CloudWatch metrics and perform actions based on their value. You can, e.g., set a threshold on key utilization metrics and trigger an automated auto-scaling action to add or remove EC2 instances.
AWS Quicksight is a fully-managed business intelligence service, which allows you to create visualizations of data and design interactive dashboards for application analysis. These dashboards can be accessed from any mobile device or browser. You can embed them into your applications, portals, or websites, providing you with powerful self-service analytics. QuickSight allows you to connect to and import data from a wide variety of cloud or on-premises data sources and scales to tens of thousands of users without any infrastructure to manage.
Database
Amazon DynamoDB is a NoSQL database service that supports key-value pairs and document data structures. As it is a fully-managed service, you don’t have to worry about hardware provisioning, setup, and configuration, replication, backups, software patching, or cluster scaling. It provides features like high availability and durability, automatic and infinite read-write I/O scaling, on-demand backup with point-in-time recovery, encryption at rest, and single-digit millisecond latency. With its pay-per-use pricing model and integration with many other AWS services, DynamoDB is a great database service for many serverless applications on AWS.
Amazon Aurora is a fully-managed relational database engine that’s compatible with MySQL and PostgreSQL. It automates and standardizes database clustering and replication to remove time-consuming administration tasks, like hardware provisioning, storage autoscaling, database setup, patching, and backups. Aurora is also available as an on-demand configuration, called Aurora Serverless, with autoscaling for compute capacity, which is a cost-effective way to support infrequent and unpredictable workloads.
Analytics
Amazon Kinesis is a fully-managed and highly scalable streaming service to collect, process, and analyze real-time streaming data, such as website clickstreams, database event streams, financial transactions, social media feeds, application logs, and IoT telemetry data, or location-tracking events. It enables you to process and analyze data as it arrives and to respond instantly so that you can create real-time applications. Amazon Kinesis consists of 3 services, which can be used to process the streaming data. With Amazon Kinesis Data Streams, you can ingest and store large data streams in real-time without managing the infrastructure, storage, networking, and configuration. Applications can consume data from a stream, so that multiple actions, like data analysis, archiving, or processing can take place concurrently and independently. Amazon Kinesis Data Firehose can be used to load streaming data into data lakes (Amazon Redshift), data stores (S3), and analytics tools (Amazon Elasticsearch). It allows you to capture, transform, and load (ETL) streaming data in real-time from many data sources simultaneously and send it automatically to the specified destination. With Amazon Kinesis Data Analytics you can filter, aggregate, and transform streaming data for advanced analytics. You can run standard SQL queries against streaming data to perform time-series analytics, provide data to real-time dashboards, and extract metrics.
Amazon Athena is a query service that provides a standard SQL language to analyze large-scale datasets in AWS Simple Storage Service (S3). There is no infrastructure to manage, and you pay only for the executed queries. Athena scales automatically by executing queries in parallel. This makes it simple to do ad-hoc analysis or more complex analyses that contain large joins.
Conclusion
AWS provides many services which can be used as building blocks to create cloud infrastructures for virtually any workload. Solution architects and developers have a huge range of tools and services to design and implement backend applications in a very effective way with great flexibility.
Most services provided by AWS are fully-managed and can be used without time-consuming administrative tasks, infrastructure provisioning, or server maintenance. Developers can focus on creating their core applications, which increases development speed and business growth. Important aspects like high availability, automatic scalability, security, and durability are built-in.
This is a huge advantage compared to using open-source services hosted on manually provisioned server infrastructures. With the pay-as-you-go pricing model, you have no upfront costs or long-term contracts and pay only for the consumed resources, which makes serverless architectures very cost-effective.
