Articles by Tag #kafka
Browse our collection of articles on various topics related to IT technologies. Dive in and explore something new!
Introducing klag: The Kafka Lag Exporter I Always Wanted.
klag - fast, lightweight and feature rich kafka lag exporter.
S3-Native Kafka Alternatives: What's Actually Different
I work on KafScale, so take this with appropriate salt. But I've also spent time looking at...
How I Reduced Kafka Boilerplate by 90% with Curve - A Declarative Event Library for Spring Boot
I built Curve, an open-source Spring Boot library that turns 30+ lines of Kafka event publishing code...
Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)
"Redpanda looked like the holy grail — Kafka-compatible, lightning fast, no ZooKeeper, no JVM. Then...
We Migrated From Kafka to Redpanda — What Actually Happened
There’s a specific kind of exhaustion that comes from running Apache Kafka in production for long...
How to Guarantee True Ordering in Complex Kafka Replays: Solving the Determinism Nightmare
בס"ד In modern event-driven architectures, data replay is a cornerstone mechanism for incident...
Understanding Kafka Architecture - The Complete Mental Model 🧠
How all the pieces fit together to create a powerful streaming platform The...
Common Challenges in Integrating Redis and Kafka for Real-Time Microservices Monitoring
Author: Kamal Sai Devarapalli Project: EventStreamMonitor Date: 2024 Repository:...
Presentation: Building Scalable Data Pipelines with Docker and Docker Compose
Presentation: Building Scalable Data Pipelines with Docker and Docker Compose ...
Stop Writing a Kafka Consumer for Every Topic – Make It Generic in .NET
How I Built a Generic Kafka Consumer in .NET with Strategy Pattern Ever found yourself writing a...
Kafka Streams Make AI Agents Fraud Detection Smarter
How real-time streaming context transformed isolated AI agents into an intelligent fraud-fighting...
Kubernetes Scaling with KEDA: Zero-Loss Data Processing at Scale
The Challenge: Our data processing pipeline faced continuous high-volume traffic, not just...
Demystifying Confluent's Schema Registry Wire Format
Table of Contents Introduction A brief overview on Avro, JSON, and Protobuf What is Confluent's...
ECS, Lambda, or EC2? How Hexagonal Architecture Made the Choice Irrelevant
You start a project locally. Everything runs smoothly, tests are green, and infrastructure feels...
Good Things (Compression) Take Time!
Inspired by Anton Putra style of benchmarks (if you love graphs half as much as I do, you gotta check...
Understanding Kafka Complete Architecture Flow - Advanced🎯
Please read the last two articles in my Kafka series before this one — this part gets serious....
🎯 Apache Kafka Single-Node Practice Guide
Your Personal Message Delivery System Welcome to your hands-on Kafka learning journey! In...
How Software Architects Choose the Right Technology Stack
🌟 The Moment Every Architect Faces You’ve just been promoted to Solution Architect at a large...
Kafka Consumer Health Checks: Why Progress Beats Lag
Many of you have been there - it’s 3 AM, your phone buzzes, and you’re staring at an alert: “Kafka...
Making Kafka 7,658x slower for the Lulz
Welcome, ladies and gentlemen, to tonight's main event! In the left corner, we have the reigning...
Learning Apache Kafka with Python - Part 1: Producers
Learning Kafka by converting Java examples to Python - understanding producers, error handling patterns, and the poll() mechanism
Understanding Kafka Lag: Causes and Mitigation Strategies
Introduction Apache Kafka is a distributed streaming platform widely used for building...
Graceful Shutdown in Kafka: Understanding Shutdown Hooks and Thread Management
A deep dive into Java Shutdown Hooks, Singleton pattern, and Thread.join() - learning how to gracefully shutdown Kafka Consumers without losing data.
Apache Kafka Explained: A Clear Mental Model for Event-Driven Systems
TL;DR Kafka feels complicated until you stop thinking in APIs and start thinking in data flow. ...
Building a Clean Event Pipeline in Spring: From Simple Events to Async Listeners to the Outbox Pattern
Event‑driven architecture sounds simple on paper: “emit an event when something happens.” But once...
Data Processing Does Not Belong in the Message Broker
Kafka changed the industry by making event streaming practical at scale. Over time, people started...
JayNats: The Future of Message Brokers
Getting Started with JayNats: Zero-Copy Real-time CDC in Minutes A tutorial-style blog...
Understanding Kafka Producer: From Basics to Sticky Partitioner
A comprehensive guide to Kafka Producer fundamentals, including async operations, callbacks, and the Sticky Partitioner behavior with hands-on examples.
Setting Up Kafka 4.0 Locally with Docker: A Learning Journey
My experience setting up a local Kafka 4.0 development environment with Docker and KRaft mode, understanding configuration options and making informed decisions.
End-to-End YouTube Channel Analytics Pipeline
End-to-End YouTube Channel Analytics Pipeline Complete Implementation...