-
Quick CloudWatch Metric Alarm
I’m getting myself back up to speed with All Things AWS so, to get my feet wet so to speak, I spun up an EC2 instance and enabled detailed monitoring. Once the instance was live, I EC2-Connect (no SSH required) and installed the stress module. This allows some artificial stress constraints to be put on…
-
Making a Knowledge Base/Vector Store
A knowledge base is a centralized, searchable collection of information that helps people and systems find reliable answers quickly. I think of it as the place where scattered knowledge—documents, FAQs, policies, troubleshooting guides, product details, and team expertise—gets organized into something truly useful. In my past work, I’ve been building the infrastructure to save and…
-
Amazon Data Firehose
This is a service that moves data from a source location to a target location. Producers can be apps, clients, SDK, Kinesis Agent, or even Kinesis Data Streams (we’ll be exploring this in a minute), AWS IoT, CloudWatch. Records can be up to 1MB, and can be transformed potentially by a lambda function. Potential destinations…
-
SNS
Simple Notification Service (SNS) is helpful, like SQS, to decouple events with messages. Let’s walk through an example. Amazon SNS > Topics > Create Topic. Type is Standard (not FIFO), name is FirstTopic. Next, we create a subscription: I select Email and enter my email address. So the subscription is created. Right now we have…
-
SQS: Dead Letter Queue
If a message is repeatedly sent back from the consumer back to the queue for some reason – perhaps it’s a malformed message – then we need a mechanism for flagging that message, perhaps for analysis and debugging. That’s where the Dead Letter Queue comes into play. We can configure a message being sent to…
-
Publishing S3 Event Notifications to SQS Queue
In this exercise, we’re going to practice setting permissions and configuration so once an event occurs within an s3 bucket, that event notification will be sent to the SQS Queue. This is handy because with this framework, we could take that message held in the queue, save it to a database, or send a SNS…
-
SQS: Producing,Receiving
SQS is a queing service that decouples applications. This is really interesting as it points to creative building of data pipelines, ingesting data from events and then doing all sorts of cool stuff with it! Let’s get some hands on: Amazon SQS > Queue > Create queue. I’m going for tthe Standard There’s the configuration.…
-
Docker and Containers
Containers are lightweight computer services and I’m going to work on exploring this technology. First, to create a cluster, which groups tasks, services together. First, go to ECS and create a cluster. For this example, I’m going to select both Fargate, which is serverless provisioning, and EC2 Instances, which requires manual configuration. Since I selected…
-
Subscribe
Subscribed
Already have a WordPress.com account? Log in now.
davethemaker 