In this post, we'll look at how to use the new automatic compaction feature in AWS Glue and how it can help optimize your Iceberg tables. Use my handy helper script to create an Iceberg table, load sample data into it, and test this new feature hands-on.
Amazon Managed Grafana has an unfortunate limitation where API keys created have a maximum expiration of 30 days - making continuous deployments difficult without manual intervention. This post will show you how to write some simple Terraform to automatically rotate an API key that can be used in your CI/CD pipeline.
Microsoft Power Automate can simplify the process of sorting incoming emails from AWS Config and AWS Security Hub. The tool can automate the sorting, categorizing and prioritizing of alerts, freeing up your time to focus on other important tasks.
Setup GitHub Codespaces with AWS IAM Roles Anywhere and authenticate your development environment with AWS securely without the need to have long-lived access tokens and ad-hoc user accounts.
Want to feel like a command line guru? Check out some of my recommendations to supercharge your CLI experience.
I got my hands on a LilyGo T-Watch 2020 and decided to build the ultimate cat lover accessory. Join me as I take you through building the ultimate cat watch.
Recap of the Internet of Things landscape for June 2020
Getting started with AWS DeepRacer can be daunting, but in reality is a really simple process. In this guide we go through the steps needed to create your very own DeepRacer model
AWS IoT Greengrass setup for the NVIDIA Jetson Nano Developer Kit. In this guide we take you through the setup process required to flash a new board and connect it to AWS IoT Greengrass.
On August 16th, 2019 Selfie2Anime went live to unexpected success. Unfortunately, the code deployed wasn't anywhere near ready for the load we experienced and some bad decisions were made in the heat of the moment to get everything up and running. 8 months on and we're dealing with the consequences of those decisions every day. In this post, I tell the tale of how we came to terms with our problems and learnt to deal with them.
Recap of the Internet of Things landscape for May 2020
Building a Dog Bark Detector to help understand what my dogs do while I'm not home. In this post we cover how to deploy a simple frontend that leverages AppSync resolvers for DynamoDB and build a simple Vue dashboard for interacting with the bark events.
Building a Dog Bark Detector to help understand what my dogs do while I'm not home. In this post we cover how to extract and process audio from video clips using a Serverless lambda processor and FFMPEG layers.
I recently passed my Certified Kubernetes Administrator (CKA) exam and along the journey made note of a number of useful resources. Hopefully some of this information can better prepare you for your own exam.
Recap of the Internet of Things landscape for April 2020
Building a Dog Bark Detector to help understand what my dogs do while I'm not home. In this post we cover the training and deployment of a Machine Learning module using the UrbanSound8K dataset.
Generate Fake Facebook conversations using OpenAI's GPT-2 training model and a large number of your existing facebook message data. Perform training using Amazon SageMaker GPU instances and CloudFormation.
Kubeflow can better equips your Data science team with a self service access to all the resources they might need to build out Machine learning pipelines and applications. Pair this with Cognito and you have a secure way to work on data projects from anywhere in the world collaboratively.
Recap of the Internet of Things landscape for March 2020
Developing simple AWS IoT projects using the Espressif IoT Development Framework (ESP-IDF) and PlatformIO
Deploy Folding@Home on Amazon Fargate quick and easily with AWS CDK
Are you a beginner to developing for The Internet of Things? Perhaps you're an expert but are curious about what new things there are to focus on in? Let's chat about what it means to develop IoT projects in 2020.
Let's talk about the reasons why you haven't built your Internet of Things project ideas. Let me know!
Google's Lighthouse CI is a programmatic tool that allows you to analyse your web apps and generate detailed reports around best practices building for the web. In this post we're going to explore how we might integrate these tests into our GatsbyJS build pipeline.
I recently passed my AWS Certified Solutions Architect Professional exam and along my journey of studying I scribbled down a bunch of notes I took. I thought it would be a good idea to share these random bits of information so that they can be used as flash cards / bite sized chunks of information.
Reduce security and operational complexity by managing your SSH key-pairs, usernames and hosts in the config file within your home SSH directory.
Using Serverless to consume and processing WA Animals adoption forms using Amazon Textract and placing that data in DynamoDB
Join us as we go through the A to Z of IoT from an AWS perspective. We won't be using buzzwords or hand-waving, just talking about the awesome services and how they can be used more effectively.
Learn how to use Conda environments to manage hundreds of different & varying python environments. Clean up your projects and make them more repeatable.
AWS AppSync is a highly flexible API service backed with GraphQL. Recently X-Ray support was launched for AppSync, so we go through the setup process and some general usage patterns for this excellent service.