---
id: "google-datastream"
type: "component"
kind: "change-data-capture"
provider: "gcp"
category: "messaging"
docs: "https://docs.cloud.google.com/datastream/docs/behavior-overview"
url: "https://localhost:3000/catalogue/components/google-datastream"
---

# Datastream

Serverless log-based change data capture and replication from operational databases.

| | |
|---|---|
| Provider | [gcp](https://localhost:3000/catalogue?provider=gcp) |
| Kind | [Change data capture](https://localhost:3000/catalogue/kinds/change-data-capture) |
| Category | Messaging |
| Official docs | [https://docs.cloud.google.com/datastream/docs/behavior-overview](https://docs.cloud.google.com/datastream/docs/behavior-overview) |

## Properties

| property | type | values | required | kind default | this component |
|---|---|---|---|---|---|
| `backfillMode` | enum | `automatic`, `manual` | no | — | inherited |
| `managed` | boolean | — | no | false | **true** |
| `mode` | enum | `log-based`, `trigger`, `polling` | no | "log-based" | **"log-based"** |
| `ordered` | boolean | — | no | true | inherited |
| `schemaEvolution` | boolean | — | no | false | inherited |
| `sourceEngine` | enum | `mysql`, `oracle`, `postgresql`, `sqlserver`, `mongodb`, `spanner` | no | — | inherited |
| `startOnCreate` | boolean | — | no | false | inherited |

Bold values are the ones this component pins.

## Rules that apply · 0

No rule selects this kind or its category.

## Other products of the same kind · 14

- [Data Transmission Service](https://localhost:3000/catalogue/components/alibaba-dts.md) `alibaba-dts` — alibabacloud
- [AWS DMS](https://localhost:3000/catalogue/components/aws-dms.md) `aws-dms` — aws
- [Amazon DynamoDB Streams](https://localhost:3000/catalogue/components/aws-dynamodb-streams.md) `aws-dynamodb-streams` — aws
- [Brooklin](https://localhost:3000/catalogue/components/brooklin.md) `brooklin` — default
- [Alibaba Canal](https://localhost:3000/catalogue/components/canal.md) `canal` — default
- [Generic change data capture](https://localhost:3000/catalogue/components/change-data-capture.md) `change-data-capture` — default
- [Debezium](https://localhost:3000/catalogue/components/debezium.md) `debezium` — default
- [Estuary Flow](https://localhost:3000/catalogue/components/estuary.md) `estuary` — default
- [Apache Kafka Connect](https://localhost:3000/catalogue/components/kafka-connect.md) `kafka-connect` — default
- [Maxwell](https://localhost:3000/catalogue/components/maxwell.md) `maxwell` — default
- [Striim](https://localhost:3000/catalogue/components/striim.md) `striim` — default
- [Database Migration Service](https://localhost:3000/catalogue/components/google-database-migration-service.md) `google-database-migration-service` — gcp
- [IBM Data Replication](https://localhost:3000/catalogue/components/ibm-data-replication.md) `ibm-data-replication` — ibm
- [OCI GoldenGate](https://localhost:3000/catalogue/components/oci-goldengate.md) `oci-goldengate` — oci

## Use it in a design

```yaml
nodes:
  - { id: "google-datastream", component: "google-datastream" }
```

## Source (`component` YAML, verbatim)

```yaml
# yaml-language-server: $schema=../../schema/component.schema.json
# Datastream: serverless change data capture and replication. "Datastream overview" and "Datastream
# behavior and limitations": CDC reads the source write-ahead log (LogMiner for Oracle), the service
# scales up and down on its own, and a new stream is created without starting unless the create and
# start action is used.
schemaVersion: "1"
type: "component"
id: "google-datastream"
kind: "change-data-capture"
provider: "gcp"
docs: "https://docs.cloud.google.com/datastream/docs/behavior-overview"
defaults:
  managed: true
  mode: "log-based"
properties:
  sourceEngine:
    type: "enum"
    values: ["mysql", "oracle", "postgresql", "sqlserver", "mongodb", "spanner"]
  backfillMode:
    type: "enum"
    values: ["automatic", "manual"]
  startOnCreate:
    type: "boolean"
    default: false
```

Human page: https://localhost:3000/catalogue/components/google-datastream