Konstantinas Mamonas articles - 9 total
What’s Inside gzip, zstd, and Other Lossless Compressors
Compression shows up everywhere - logs, Kafka, Parquet, file systems, APIs - but most engineers use...
Parquet? What Parquet?
If you’re in data, you’re probably using Parquet. It’s not officially the standard, but good luck...
Which Compression Saves the Most Storage $? (gzip, Snappy, LZ4, zstd)
Compression setting are set and forget in most cases, if it works no reason to change it. I decided...
Compression Algorithms You Probably Inherited: gzip, Snappy, LZ4, zstd
You Might Be Using The Wrong Compression Algorithm If you work in data engineering, you’ve...
DuckDB: When You Don’t Need Spark (But Still Need SQL)
The Problem Too often, data engineering tasks that should be simple end up requiring...
kafka-replay-cli: A Lightweight Kafka Replay & Debugging Tool
Project Links GitHub: github.com/KonMam/kafka-replay-cli PyPI:...
Kafka Producers Explained: Partitioning, Batching, and Reliability
A Kafka producer is the entry point for all data written to Kafka. It sends records to specific topic...
Kafka Consumers Explained: Pull, Offsets, and Parallelism
Kafka is built for high throughput, scalability, and fault tolerance. At the core of this is its...
How Kafka Achieves High Throughput: A Breakdown of Its Log-Centric Architecture
Kafka routinely handles millions of messages per second on commodity hardware. This performance isn't...