News, guides, and engineering deep dives.
Practical guidance on Kafka, Flink, Iceberg, and real-time data.
What is envelope encryption?
Envelope encryption encrypts data with a local data key, then wraps that key with a KMS-held key. On Kafka it is the pattern that makes per-field encryption work at full throughput.
What is Kafka Connect?
Kafka Connect streams data between Kafka and other systems as managed, fault-tolerant tasks. The internal architecture, production scaling, error handling and custom development.
What is Kafka rebalancing?
Kafka rebalancing redistributes a consumer group's partitions when membership changes. The triggers, the three timeouts, cooperative rebalancing, KIP-848 and the metrics that explain incidents.
What is RabbitMQ?
RabbitMQ explained for Kafka operators: the AMQP queue model, broker-side routing, push delivery, streams, and where it fits beside a Kafka deployment.
What is Redpanda?
Redpanda reimplements the Kafka wire protocol in a single C++ binary. The architecture, the drop-in compatibility boundaries, and how to evaluate it against tiered-storage Kafka.
Kafka: The Complete Guide
Apache Kafka is a distributed event streaming platform that stores ordered, replayable records in partitioned topics. This hub covers Kafka fundamentals, operations, governance and tooling.
Apache Kafka architecture: a complete guide
A complete guide to Apache Kafka architecture: internals, components, KRaft, replication, consumers, Connect, Streams, and deployment options.
Kafka brokers in production
A Kafka broker is the server that stores partition logs and serves produce and fetch traffic. Configuration, troubleshooting, JMX metrics, maintenance and network tuning for production.
Kafka consumers in production
A Kafka consumer reads records from topic partitions, tracking its own offset. The configuration that decides message loss, rebalance troubleshooting, and poll-loop patterns that survive production.