WarpStream

Streamwarpstream

Kafka-compatible cluster whose stateless agents store all data directly in object storage.

Provider: default
Kind: Stream
Category: Messaging
Official docs: https://docs.warpstream.com/warpstream/overview/architecture

Properties · 4 set by this component

property	type	values	required	kind default	this component
acks	enum	none \| leader \| quorum \| all	no	—	inherited
compaction	boolean	—	no	false	inherited
delivery	enum	at-most-once \| at-least-once \| exactly-once	no	at-least-once	▸ at-least-once
idempotentProducer · advanced	boolean	—	no	false	inherited
managed	boolean	—	no	false	▸ true
minInsyncReplicas	integer	—	no	—	inherited
objectStore · component property	enum	s3 \| gcs \| azure-blob \| s3-compatible	no	s3	inherited
ordering	enum	per-key \| global	no	per-key	▸ per-key
partitions	integer	—	no	—	inherited
replicationFactor	integer	—	no	—	inherited
retentionHours	integer	—	no	—	inherited
schemaEnforced	boolean	—	no	false	inherited
statelessAgents · component property	boolean	—	no	true	inherited
storage	enum	ephemeral \| persistent	no	persistent	▸ persistent
transactions · advanced	boolean	—	no	false	inherited
zoneAlignedRouting · component property	boolean	—	no	true	inherited

Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.

Use it in a design

nodes:
  - { id: "warpstream", component: "warpstream" }

Other Stream products · 18

DataHubalibaba-datahubalibabacloudstream ApsaraMQ for Kafkaalibaba-kafkaalibabacloudstream Amazon Kinesis Video Streamsaws-kinesis-video-streamsawsstream Amazon Managed Streaming for Apache Kafkaaws-mskawsstream Amazon Kinesis Data Streamskinesisawsstream Azure Event Hubsazure-event-hubsazurestream AutoMQautomqstream Confluent Cloudconfluent-cloudstream Apache Kafkakafkastream NATS JetStreamnats-jetstreamstream Apache Pulsarpulsarstream Redpandaredpandastream Apache RocketMQrocketmqstream Generic streamstreamstream Managed Service for Apache Kafkagoogle-managed-kafkagcpstream IBM Event Streamsibm-event-streamsibmstream OCI Streamingoci-streamingocistream OCI Streaming with Apache Kafkaoci-streaming-kafkaocistream

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# WarpStream: Kafka-compatible cluster whose stateless agents keep no local disks and stream records
3# straight into object storage, so durability and replication come from the object store while the
4# metadata lives in a hosted control plane ("WarpStream Architecture").
5schemaVersion: "1"
6type: "component"
7id: "warpstream"
8kind: "stream"
9provider: "default"
10docs: "https://docs.warpstream.com/warpstream/overview/architecture"
11defaults:
12  delivery: "at-least-once"
13  ordering: "per-key"
14  storage: "persistent"
15  managed: true
16properties:
17  objectStore:
18    type: "enum"
19    values: ["s3", "gcs", "azure-blob", "s3-compatible"]
20    default: "s3"
21  statelessAgents:
22    type: "boolean"
23    default: true
24  zoneAlignedRouting:
25    type: "boolean"
26    default: true

The same page as markdown, for an agent: /catalogue/components/warpstream.md