Jacob articles - 16 total
Setting Up IOMete: A Cloud-Independent Data Platform Based on Spark
IOMete is a powerful, cloud-independent data platform built on Apache Spark, designed to enable...
DUCKDB, S3 Tables with iceberg using Iceberg Rest API
I wrote my previous article about Duckberg, a combination of PyIceberg with Duckdb to access iceberg...
Duckberg!
I wrote a previous small blog about PyIceberg and Glue iceberg Rest Api This week is saw the...
Collibra Protect , Snowflake and Iceberg tables
Iceberg is gaining traction, and Collibra is expanding its presence as a data governance tool,...
AWS Glue vulnerabilities in default packages
Securing AWS Glue: A Guide to Identifying and Fixing Python Package Vulnerabilities ...
Unity Catalog Iceberg Rest Api and PyIceberg
Access Unity tables via the Iceberg Rest Api After working with glue catalog in the...
Glue Iceberg Rest Api and PyIceberg
Access Glue Iceberg tables via the Iceberg Rest Api AWS Released silently Iceberg REST-API...
Bridging Clouds: A Guide to Connecting AWS Glue Tables with Snowflake
In today's data-driven world, organizations often find themselves working with multiple cloud...
Sustainability on AWS
Sustainability is the new topic on AWS. While it has a lot in common with FinOps, it adds emphasis to...
Purge a glue table from cli
Sometimes you want to purge a glue table from s3 and delete all files and versions. Lately i had to...
Data Engineering and ChatGPT (Part2)
In my previous post i must have hit some issue with ChatGPT. It's way more impressive then i...
Data Engineering and ChatGPT
ChatGPT is out and everybody is trying it. Blogs, songs are easy, but can it help with Data...
Re:invent 2022 Releases sorted
An overview of all the releases sorted per group. This re:invent was very focused on Data &...
New EC2 Models re:invent 2022
AWS Released 5 new EC2 models in Re:invent 2022. Hereby an...
Overview of the features released for Step Functions
At the Dutch AWS Community Day 2022, i held the following talk. An overview of all the features...
Secrets and AWS GLUE Custom Connectors
For a project i had to retrieve data from Teradata using a Glue Job. A quick google gave me this:...