Orchestration Pipelines

gcp Workflow enginegoogle-orchestration-pipelines

Declarative YAML data and AI pipelines deployed onto Managed Airflow.

Provider: gcp
Kind: Workflow engine
Category: Compute
Official docs: https://docs.cloud.google.com/orchestration-pipelines/overview

Properties · 2 set by this component

property	type	values	required	kind default	this component
compensation	boolean	—	no	false	inherited
durable	boolean	—	no	true	inherited
humanReview	boolean	—	no	false	inherited
managed	boolean	—	no	false	▸ true
pattern	enum	saga \| tcc \| two-phase-commit \| dag	no	dag	▸ dag
runner · component property	enum	managed-airflow-gen2 \| managed-airflow-gen3	no	—	inherited
stepsIdempotent	boolean	—	no	false	inherited
trigger · component property	enum	scheduled \| manual	no	—	inherited
versionedBundles · component property	boolean	—	no	true	inherited

Rules that apply · 1

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

Stateful node without zone redundancyerror

stateful-node-without-zone-redundancy

A stateful compute node pinned to exactly one availability zone disappears with that zone, and its state goes with it. Nodes inside a cell are exempt, because there the cell is deliberately single-zone and redundancy comes from the other cells.

— all of these hold:
— the node's `stateless` is false
— the node sits inside exactly 1 availability-zone group
— this does not hold:
— the node sits inside at least one cell group

Use it in a design

nodes:
  - { id: "orchestration-pipelines", component: "google-orchestration-pipelines" }

Other Workflow engine products · 44

CloudFlowalibaba-cloudflowalibabacloudworkflow-engine CloudOps Orchestration Servicealibaba-oosalibabacloudworkflow-engine Amazon Augmented AI (A2I)aws-augmented-aiawsworkflow-engine Amazon Managed Workflows for Apache Airflowaws-mwaaawsworkflow-engine AWS Systems Manager Incident Manager and Change Manageraws-ssm-incident-and-change-managerawsworkflow-engine AWS Step Functionsaws-step-functionsawsworkflow-engine Amazon Simple Workflow Serviceaws-swfawsworkflow-engine Azure Durable Functionsazure-durable-functionsazureworkflow-engine Azure Logic Appsazure-logic-appsazureworkflow-engine Cloudflare Workflowscloudflare-workflowscloudflareworkflow-engine Apache Airflowairflowworkflow-engine Argo Workflowsargo-workflowsworkflow-engine Astronomer Astroastronomerworkflow-engine Cadencecadenceworkflow-engine Camunda 8camundaworkflow-engine Conductorconductorworkflow-engine Dagsterdagsterworkflow-engine Digdagdigdagworkflow-engine Flowableflowableworkflow-engine Inngestinngestworkflow-engine jBPMjbpmworkflow-engine Kestrakestraworkflow-engine Luigiluigiworkflow-engine n8nn8nworkflow-engine Node-REDnode-redworkflow-engine Prefectprefectworkflow-engine Prefect Cloudprefect-cloudworkflow-engine Restaterestateworkflow-engine Temporaltemporalworkflow-engine Temporal Cloudtemporal-cloudworkflow-engine Trigger.devtrigger-devworkflow-engine Windmillwindmillworkflow-engine Workatoworkatoworkflow-engine Generic workflow engineworkflow-engineworkflow-engine Zapierzapierworkflow-engine Application Integrationgoogle-application-integrationgcpworkflow-engine Cloud Composer (Managed Service for Apache Airflow)google-cloud-composergcpworkflow-engine Workflowsgoogle-cloud-workflowsgcpworkflow-engine IBM App Connectibm-app-connectibmworkflow-engine Oracle Integration 3oci-integrationociworkflow-engine

and 4 more → Workflow engine page

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# Orchestration Pipelines: declarative YAML pipelines for data and AI workflows, deployed onto
3# Managed Service for Apache Airflow. "Orchestration Pipelines overview": pipelines ship as versioned
4# bundles deployed per environment, and runs are either scheduled or started manually.
5schemaVersion: "1"
6type: "component"
7id: "google-orchestration-pipelines"
8kind: "workflow-engine"
9provider: "gcp"
10docs: "https://docs.cloud.google.com/orchestration-pipelines/overview"
11defaults:
12  managed: true
13  pattern: "dag"
14properties:
15  runner:
16    type: "enum"
17    values: ["managed-airflow-gen2", "managed-airflow-gen3"]
18  trigger:
19    type: "enum"
20    values: ["scheduled", "manual"]
21  versionedBundles:
22    type: "boolean"
23    default: true

The same page as markdown, for an agent: /catalogue/components/google-orchestration-pipelines.md