Dagster
Workflow enginedagster
Asset-oriented orchestrator with persisted run history and event logs.
- Provider
- default
- Kind
- Workflow engine
- Category
- Compute
| property | type | values | required | kind default | this component |
|---|---|---|---|---|---|
| compensation | boolean | — | no | false | ▸ false |
| durable | boolean | — | no | true | ▸ true |
| humanReview | boolean | — | no | false | inherited |
| managed | boolean | — | no | false | ▸ false |
| pattern | enum | saga | tcc | two-phase-commit | dag | no | dag | ▸ dag |
| retryPolicy | boolean | — | no | false | inherited |
| stepsIdempotent | boolean | — | no | false | inherited |
| storage | enum | sqlite | postgres | mysql | no | sqlite | inherited |
Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.
stateful-node-without-zone-redundancy
A stateful compute node pinned to exactly one availability zone disappears with that zone, and its state goes with it. Nodes inside a cell are exempt, because there the cell is deliberately single-zone and redundancy comes from the other cells.
- — all of these hold:
- — the node's `stateless` is false
- — the node sits inside exactly 1 availability-zone group
- — this does not hold:
- — the node sits inside at least one cell group
nodes:
- { id: "dagster", component: "dagster" }CloudFlowalibaba-cloudflowCloudOps Orchestration Servicealibaba-oosAmazon Augmented AI (A2I)aws-augmented-aiAmazon Managed Workflows for Apache Airflowaws-mwaaAWS Systems Manager Incident Manager and Change Manageraws-ssm-incident-and-change-managerAWS Step Functionsaws-step-functionsAmazon Simple Workflow Serviceaws-swfAzure Durable Functionsazure-durable-functionsAzure Logic Appsazure-logic-appsCloudflare Workflowscloudflare-workflowsApache AirflowairflowArgo Workflowsargo-workflowsAstronomer AstroastronomerCadencecadenceCamunda 8camundaConductorconductorDigdagdigdagFlowableflowableInngestinngestjBPMjbpmKestrakestraLuigiluigin8nn8nNode-REDnode-redPrefectprefectPrefect Cloudprefect-cloudRestaterestateTemporaltemporalTemporal Cloudtemporal-cloudTrigger.devtrigger-devWindmillwindmillWorkatoworkatoGeneric workflow engineworkflow-engineZapierzapierApplication Integrationgoogle-application-integrationCloud Composer (Managed Service for Apache Airflow)google-cloud-composerWorkflowsgoogle-cloud-workflowsOrchestration Pipelinesgoogle-orchestration-pipelinesIBM App Connectibm-app-connectOracle Integration 3oci-integration
and 4 more → Workflow engine page# yaml-language-server: $schema=../../schema/component.schema.json # Dagster: asset/op graph orchestrator. With DAGSTER_HOME set, run history and event logs are # persisted to SQLite on the local filesystem unless Postgres or MySQL is configured # ("OSS instance configuration"). Retries need an explicit RetryPolicy on the op or asset. schemaVersion: "1" type: "component" id: "dagster" kind: "workflow-engine" provider: "default" docs: "https://docs.dagster.io/deployment/oss/oss-instance-configuration" defaults: durable: true pattern: "dag" compensation: false managed: false properties: storage: type: "enum" values: ["sqlite", "postgres", "mysql"] default: "sqlite" retryPolicy: type: "boolean" default: false