Cloud Composer (Managed Service for Apache Airflow)

gcp Workflow enginegoogle-cloud-composer

Fully managed Apache Airflow environment for orchestrating DAGs.

Provider: gcp
Kind: Workflow engine
Category: Compute
Official docs: https://docs.cloud.google.com/composer/docs/composer-3/composer-overview

Properties · 2 set by this component

property	type	values	required	kind default	this component
compensation	boolean	—	no	false	inherited
durable	boolean	—	no	true	inherited
generation · component property	enum	gen-1 \| gen-2 \| gen-3	no	—	inherited
humanReview	boolean	—	no	false	inherited
managed	boolean	—	no	false	▸ true
pattern	enum	saga \| tcc \| two-phase-commit \| dag	no	dag	▸ dag
resilienceMode · component property	enum	standard \| highly-resilient	no	standard	inherited
stepsIdempotent	boolean	—	no	false	inherited
zonalDatabase · component property	boolean	—	no	true	inherited

Rules that apply · 1

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

Stateful node without zone redundancyerror

stateful-node-without-zone-redundancy

A stateful compute node pinned to exactly one availability zone disappears with that zone, and its state goes with it. Nodes inside a cell are exempt, because there the cell is deliberately single-zone and redundancy comes from the other cells.

— all of these hold:
— the node's `stateless` is false
— the node sits inside exactly 1 availability-zone group
— this does not hold:
— the node sits inside at least one cell group

Use it in a design

nodes:
  - { id: "cloud-composer", component: "google-cloud-composer" }

Other Workflow engine products · 44

CloudFlowalibaba-cloudflowalibabacloudworkflow-engine CloudOps Orchestration Servicealibaba-oosalibabacloudworkflow-engine Amazon Augmented AI (A2I)aws-augmented-aiawsworkflow-engine Amazon Managed Workflows for Apache Airflowaws-mwaaawsworkflow-engine AWS Systems Manager Incident Manager and Change Manageraws-ssm-incident-and-change-managerawsworkflow-engine AWS Step Functionsaws-step-functionsawsworkflow-engine Amazon Simple Workflow Serviceaws-swfawsworkflow-engine Azure Durable Functionsazure-durable-functionsazureworkflow-engine Azure Logic Appsazure-logic-appsazureworkflow-engine Cloudflare Workflowscloudflare-workflowscloudflareworkflow-engine Apache Airflowairflowworkflow-engine Argo Workflowsargo-workflowsworkflow-engine Astronomer Astroastronomerworkflow-engine Cadencecadenceworkflow-engine Camunda 8camundaworkflow-engine Conductorconductorworkflow-engine Dagsterdagsterworkflow-engine Digdagdigdagworkflow-engine Flowableflowableworkflow-engine Inngestinngestworkflow-engine jBPMjbpmworkflow-engine Kestrakestraworkflow-engine Luigiluigiworkflow-engine n8nn8nworkflow-engine Node-REDnode-redworkflow-engine Prefectprefectworkflow-engine Prefect Cloudprefect-cloudworkflow-engine Restaterestateworkflow-engine Temporaltemporalworkflow-engine Temporal Cloudtemporal-cloudworkflow-engine Trigger.devtrigger-devworkflow-engine Windmillwindmillworkflow-engine Workatoworkatoworkflow-engine Generic workflow engineworkflow-engineworkflow-engine Zapierzapierworkflow-engine Application Integrationgoogle-application-integrationgcpworkflow-engine Workflowsgoogle-cloud-workflowsgcpworkflow-engine Orchestration Pipelinesgoogle-orchestration-pipelinesgcpworkflow-engine IBM App Connectibm-app-connectibmworkflow-engine Oracle Integration 3oci-integrationociworkflow-engine

and 4 more → Workflow engine page

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# Cloud Composer, renamed Managed Service for Apache Airflow: fully managed Airflow environment that
3# runs DAGs. "Managed Airflow overview": standard environments have a zonal Airflow database and a
4# multi-zonal execution layer; the highly resilient mode is opt-in and recommended for production.
5schemaVersion: "1"
6type: "component"
7id: "google-cloud-composer"
8kind: "workflow-engine"
9provider: "gcp"
10docs: "https://docs.cloud.google.com/composer/docs/composer-3/composer-overview"
11defaults:
12  managed: true
13  pattern: "dag"
14properties:
15  generation:
16    type: "enum"
17    values: ["gen-1", "gen-2", "gen-3"]
18  resilienceMode:
19    type: "enum"
20    values: ["standard", "highly-resilient"]
21    default: "standard"
22  zonalDatabase:
23    type: "boolean"
24    default: true

The same page as markdown, for an agent: /catalogue/components/google-cloud-composer.md