Apache Kafka

Partitioned, replicated, replayable commit log read by consumer groups.

Provider: default
Kind: Stream
Category: Messaging
Official docs: https://kafka.apache.org/documentation/

Properties · 8 set by this component

property	type	values	required	kind default	this component
acks	enum	none \| leader \| quorum \| all	no	—	▸ leader
compaction	boolean	—	no	false	inherited
consumerGroups · component property	boolean	—	no	true	inherited
delivery	enum	at-most-once \| at-least-once \| exactly-once	no	at-least-once	▸ at-least-once
idempotentProducer · advanced	boolean	—	no	false	inherited
managed	boolean	—	no	false	▸ false
minInsyncReplicas	integer	—	no	—	inherited
ordering	enum	per-key \| global	no	per-key	▸ per-key
partitions	integer	—	no	—	▸ 1
replicationFactor	integer	—	no	—	▸ 1
retentionHours	integer	—	no	—	▸ 168
schemaEnforced	boolean	—	no	false	inherited
storage	enum	ephemeral \| persistent	no	persistent	▸ persistent
transactions · advanced	boolean	—	no	false	inherited

Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.

Use it in a design

nodes:
  - { id: "kafka", component: "kafka" }

Other Stream products · 18

DataHubalibaba-datahubalibabacloudstream ApsaraMQ for Kafkaalibaba-kafkaalibabacloudstream Amazon Kinesis Video Streamsaws-kinesis-video-streamsawsstream Amazon Managed Streaming for Apache Kafkaaws-mskawsstream Amazon Kinesis Data Streamskinesisawsstream Azure Event Hubsazure-event-hubsazurestream AutoMQautomqstream Confluent Cloudconfluent-cloudstream NATS JetStreamnats-jetstreamstream Apache Pulsarpulsarstream Redpandaredpandastream Apache RocketMQrocketmqstream Generic streamstreamstream WarpStreamwarpstreamstream Managed Service for Apache Kafkagoogle-managed-kafkagcpstream IBM Event Streamsibm-event-streamsibmstream OCI Streamingoci-streamingocistream OCI Streaming with Apache Kafkaoci-streaming-kafkaocistream

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# Apache Kafka: partitioned replayable log. Broker defaults are one partition, replication factor 1,
3# leader-only acks and 7-day retention, which is why the durability rules exist.
4schemaVersion: "1"
5type: "component"
6id: "kafka"
7kind: "stream"
8provider: "default"
9docs: "https://kafka.apache.org/documentation/"
10defaults:
11  delivery: "at-least-once"
12  ordering: "per-key"
13  partitions: 1
14  replicationFactor: 1
15  acks: "leader"
16  retentionHours: 168
17  storage: "persistent"
18  managed: false
19properties:
20  consumerGroups:
21    type: "boolean"
22    default: true

The same page as markdown, for an agent: /catalogue/components/kafka.md