Apache Kafka Connect

Worker framework that streams data between Kafka and external systems through source and sink connectors.

Provider: default
Kind: Change data capture
Category: Messaging
Official docs: https://docs.confluent.io/platform/current/connect/references/allconfigs.html

Properties · 2 set by this component

property	type	values	required	kind default	this component
connectorDirection · component property	enum	source \| sink	no	source	inherited
deploymentMode · component property	enum	standalone \| distributed	no	—	inherited
managed	boolean	—	no	false	▸ false
mode	enum	log-based \| trigger \| polling	no	log-based	inherited
offsetFlushIntervalMs · component property	integer	—	no	60000	inherited
ordered	boolean	—	no	true	▸ true
schemaEvolution	boolean	—	no	false	inherited

Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.

Use it in a design

nodes:
  - { id: "kafka-connect", component: "kafka-connect" }

Other Change data capture products · 14

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# Apache Kafka Connect: worker framework that streams data between Kafka and external systems; source
3# and sink connector offsets are committed to Kafka topics every 60 seconds by default
4# ("Kafka Connect", "Kafka Connect Worker Configuration Reference").
5schemaVersion: "1"
6type: "component"
7id: "kafka-connect"
8kind: "change-data-capture"
9provider: "default"
10docs: "https://docs.confluent.io/platform/current/connect/references/allconfigs.html"
11defaults:
12  ordered: true
13  managed: false
14properties:
15  deploymentMode:
16    type: "enum"
17    values: ["standalone", "distributed"]
18  connectorDirection:
19    type: "enum"
20    values: ["source", "sink"]
21    default: "source"
22  offsetFlushIntervalMs:
23    type: "integer"
24    default: 60000

The same page as markdown, for an agent: /catalogue/components/kafka-connect.md