Kafka

A distributed messaging engine, focused on the storage/consumption model and the engineering guarantees of reliability and exactly-once semantics.

Kafka is a high-throughput, durable distributed messaging system that backs log pipelines, event sourcing and async decoupling. This subsection explains its partitioned storage, consumption-offset model, and the key configurations behind reliability.

Articles

Storage and Consumption Model — topic/partition physical structure, offset, consumer groups and rebalance, the pull model.
Reliability and Exactly-Once — acks and retries, idempotent producer, transactions, consumer idempotency and partition ordering.

Kafka Storage and Consumption Model

topic/partition physical structure, offset and consumption position, consumer groups and rebalance, the pull model.

Kafka Reliability and Exactly-Once

producer acks and retries, idempotent producer and transactions, consumer-side duplicates and idempotency, and partition ordering guarantees.