Articles by Tag #kafka
Browse our collection of articles on various topics related to IT technologies. Dive in and explore something new!
S3-Native Kafka Alternatives: What's Actually Different
I work on KafScale, so take this with appropriate salt. But I've also spent time looking at...
Redpanda in Production: 3 Traps I Fell Into (and How to Avoid Them)
"Redpanda looked like the holy grail — Kafka-compatible, lightning fast, no ZooKeeper, no JVM. Then...
We Migrated From Kafka to Redpanda — What Actually Happened
There’s a specific kind of exhaustion that comes from running Apache Kafka in production for long...
How to Guarantee True Ordering in Complex Kafka Replays: Solving the Determinism Nightmare
בס"ד In modern event-driven architectures, data replay is a cornerstone mechanism for incident...
Understanding Kafka Architecture - The Complete Mental Model 🧠
How all the pieces fit together to create a powerful streaming platform The...
Presentation: Building Scalable Data Pipelines with Docker and Docker Compose
Presentation: Building Scalable Data Pipelines with Docker and Docker Compose ...
Common Challenges in Integrating Redis and Kafka for Real-Time Microservices Monitoring
Author: Kamal Sai Devarapalli Project: EventStreamMonitor Date: 2024 Repository:...
Stop Writing a Kafka Consumer for Every Topic – Make It Generic in .NET
How I Built a Generic Kafka Consumer in .NET with Strategy Pattern Ever found yourself writing a...
Understanding Kafka Complete Architecture Flow - Advanced🎯
Please read the last two articles in my Kafka series before this one — this part gets serious....
Kubernetes Scaling with KEDA: Zero-Loss Data Processing at Scale
The Challenge: Our data processing pipeline faced continuous high-volume traffic, not just...
How Software Architects Choose the Right Technology Stack
🌟 The Moment Every Architect Faces You’ve just been promoted to Solution Architect at a large...
Kafka Streams Make AI Agents Fraud Detection Smarter
How real-time streaming context transformed isolated AI agents into an intelligent fraud-fighting...
Good Things (Compression) Take Time!
Inspired by Anton Putra style of benchmarks (if you love graphs half as much as I do, you gotta check...
Demystifying Confluent's Schema Registry Wire Format
Table of Contents Introduction A brief overview on Avro, JSON, and Protobuf What is Confluent's...
🎯 Apache Kafka Single-Node Practice Guide
Your Personal Message Delivery System Welcome to your hands-on Kafka learning journey! In...
Data Processing Does Not Belong in the Message Broker
Kafka changed the industry by making event streaming practical at scale. Over time, people started...
When Kafka Goes Kaiju: Building Monster-Scale Streaming Architectures
🔥 Kafka: The Event Backbone Behind Real-Time Systems In every modern distributed system,...
Kafka Consumer Health Checks: Why Progress Beats Lag
Many of you have been there - it’s 3 AM, your phone buzzes, and you’re staring at an alert: “Kafka...
From AWS Kinesis to Apache Kafka: Building a Real-Time Streaming Bridge
Introduction: In one of my recent projects, I needed to replicate data from an AWS Kinesis...
Kafka | everything you need to get started
Decoding Kafka: The Architectural Shift to Scalable, Decoupled Systems Apache Kafka is one...
Learning Apache Kafka with Python - Part 1: Producers
Learning Kafka by converting Java examples to Python - understanding producers, error handling patterns, and the poll() mechanism
ECS, Lambda, or EC2? How Hexagonal Architecture Made the Choice Irrelevant
You start a project locally. Everything runs smoothly, tests are green, and infrastructure feels...
🧠 Kafka Broker vs Controller - Complete Guide
Understanding the Two Critical Roles in Kafka's Architecture The Big Picture In...
Apache Kafka Explained: A Clear Mental Model for Event-Driven Systems
TL;DR Kafka feels complicated until you stop thinking in APIs and start thinking in data flow. ...
End-to-End YouTube Channel Analytics Pipeline
End-to-End YouTube Channel Analytics Pipeline Complete Implementation...
Making Kafka 7,658x slower for the Lulz
Welcome, ladies and gentlemen, to tonight's main event! In the left corner, we have the reigning...
Building a Clean Event Pipeline in Spring: From Simple Events to Async Listeners to the Outbox Pattern
Event‑driven architecture sounds simple on paper: “emit an event when something happens.” But once...
Understanding Kafka Producer: From Basics to Sticky Partitioner
A comprehensive guide to Kafka Producer fundamentals, including async operations, callbacks, and the Sticky Partitioner behavior with hands-on examples.
Setting Up Kafka 4.0 Locally with Docker: A Learning Journey
My experience setting up a local Kafka 4.0 development environment with Docker and KRaft mode, understanding configuration options and making informed decisions.
Kafka Consumer Rebalancing: From Stop-the-World to Cooperative Protocol
Understanding Kafka consumer group rebalancing strategies and how Cooperative Sticky Assignor minimizes disruption during scaling events.