News, guides, and engineering deep dives.
Practical guidance on Kafka, Flink, Iceberg, and real-time data.
Industry Apache Kafka 4.3.0: A guide for platform engineers
Kafka 4.3.0 covers broker cordoning, partition size metrics, share group tuning, and tiered storage fixes. Here's what platform engineers need to act on.
Product Data lineage support in Factor Platform
Learn how Factor Platform brings OpenLineage metadata into your Kafka environment, making data ownership, PII classification, and lineage visible by default.
Industry What the IBM-Confluent deal means for Kafka users
IBM's $11B Confluent acquisition raises questions for Kafka users. Assess your lock-in risk across Schema Registry, managed connectors, and operational tooling.
Kafka: The Complete Guide
Apache Kafka is a distributed event streaming platform that stores ordered, replayable records in partitioned topics. This hub covers Kafka fundamentals, operations, governance and tooling.
Apache Kafka architecture: a complete guide
A complete guide to Apache Kafka architecture: internals, components, KRaft, replication, consumers, Connect, Streams, and deployment options.
Kafka brokers in production
A Kafka broker is the server that stores partition logs and serves produce and fetch traffic. Configuration, troubleshooting, JMX metrics, maintenance and network tuning for production.
Kafka consumers in production
A Kafka consumer reads records from topic partitions, tracking its own offset. The configuration that decides message loss, rebalance troubleshooting, and poll-loop patterns that survive production.
Kafka in Docker
Running Kafka in Docker: the official images, reliable Docker Compose topologies, the advertised.listeners trap that breaks local connections, and why a single-node container is not a deployment.
Kafka offsets
A Kafka offset is a record's position in its partition, and a committed offset is a consumer group's bookmark. Reading lag from CURRENT-OFFSET and LOG-END-OFFSET, plus the reset strategies.
Kafka producers in production
A Kafka producer appends records to topic partitions. Configuration and tuning with real numbers, idempotence and delivery guarantees, and the client-library decision that quietly matters most.
Kafka Streams
Kafka Streams is a Java library for stream processing that runs inside your application, with state in local RocksDB stores and changelog topics. The operational realities, and where Flink wins.
Kafka Streams documentation, mapped
The Kafka Streams documentation divides into four layers: API reference, configuration surface, state store internals, and the upgrade guide. Which layer answers which production question.