Materialize
Stream processormaterialize
Incremental view maintenance engine serving strongly consistent materialized views.
- Provider
- default
- Kind
- Stream processor
- Category
- Messaging
| property | type | values | required | kind default | this component |
|---|---|---|---|---|---|
| checkpointIntervalSeconds | integer | — | no | — | inherited |
| deployment | enum | cloud | self-managed | no | cloud | inherited |
| exactlyOnce | boolean | — | no | false | inherited |
| instances | integer | — | no | — | inherited |
| isolationLevel | enum | strict-serializable | serializable | bounded-staleness | no | strict-serializable | inherited |
| lateDataPolicy | enum | drop | shift | sideline | no | — | inherited |
| managed | boolean | — | no | false | ▸ true |
| stateBackend | enum | memory | rocksdb | external | no | memory | ▸ memory |
| watermarkSeconds | integer | — | no | — | inherited |
| windowing | enum | none | event-time | processing-time | no | none | ▸ none |
Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.
windowed-aggregation-without-watermark
Event-time windows need a watermark to know when a window is complete. Without one the processor either waits forever or closes windows early and silently drops late events.
- — all of these hold:
- — the node's `windowing` is "event-time"
- — the node's `watermarkSeconds` has no value
nodes:
- { id: "materialize", component: "materialize" }Realtime Compute for Apache Flinkalibaba-flinkAmazon EventBridge Pipesaws-eventbridge-pipesAmazon Data Firehoseaws-firehoseAmazon Managed Service for Apache Flinkaws-managed-flinkAmazon OpenSearch Ingestionaws-opensearch-ingestionAzure Stream Analyticsazure-stream-analyticsCloudflare Logpushcloudflare-logpushCloudflare Pipelinescloudflare-pipelinesArroyoarroyoApache BeambeamBytewaxbytewaxDrasidrasiApache FlinkflinkKafka Streamskafka-streamsksqlDBksqldbLogstashlogstashApache NiFinifiNorikranorikraRedpanda Connectredpanda-connectRisingWaverisingwaveApache SamzasamzaSnowplowsnowplowSpark Structured Streamingspark-streamingApache StormstormGeneric stream processorstream-processorTremortremorGoogle Cloud Dataflowgoogle-dataflowManufacturing Data Enginegoogle-manufacturing-data-engineActivity Tracker Event Routingibm-activity-tracker-event-routingIBM Cloud Logs Routingibm-logs-routingIBM Cloud Metrics Routingibm-metrics-routingOCI Connector Huboci-connector-hubOCI GoldenGate Stream Analyticsoci-goldengate-stream-analytics
# yaml-language-server: $schema=../../schema/component.schema.json # Materialize: incremental view maintenance engine offered as a managed cloud service, with a # self-managed deployment as an alternative. Indexes and materialized views are held by in-memory # arrangements, and the default isolation level is strict serializable, providing serializability and # linearizability ("Materialize, Isolation level" and "Key concepts"). schemaVersion: "1" type: "component" id: "materialize" kind: "stream-processor" provider: "default" docs: "https://materialize.com/docs/get-started/isolation-level/" defaults: managed: true windowing: "none" stateBackend: "memory" properties: deployment: type: "enum" values: ["cloud", "self-managed"] default: "cloud" isolationLevel: type: "enum" values: ["strict-serializable", "serializable", "bounded-staleness"] default: "strict-serializable"