Amazon Managed Workflows for Apache Airflow

Managed Apache Airflow environment running DAG-based data pipelines.

Provider: aws
Kind: Workflow engine
Category: Compute
Official docs: https://docs.aws.amazon.com/mwaa/latest/userguide/environment-class.html
Also known as: MWAA

Properties · 6 set by this component

property	type	values	required	kind default	this component
compensation	boolean	—	no	false	▸ false
durable	boolean	—	no	true	▸ true
environmentClass · component property	enum	mw1-micro \| mw1-small \| mw1-medium \| mw1-large \| mw1-xlarge \| mw1-2xlarge	no	—	inherited
humanReview	boolean	—	no	false	▸ false
managed	boolean	—	no	false	▸ true
maxWorkers · component property	integer	—	no	10	inherited
pattern	enum	saga \| tcc \| two-phase-commit \| dag	no	dag	▸ dag
schedulerCount · component property	integer	—	no	2	inherited
stepsIdempotent	boolean	—	no	false	▸ false
webserverAccessMode · component property	enum	public \| private	no	—	inherited

Rules that apply · 1

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

Stateful node without zone redundancyerror

stateful-node-without-zone-redundancy

A stateful compute node pinned to exactly one availability zone disappears with that zone, and its state goes with it. Nodes inside a cell are exempt, because there the cell is deliberately single-zone and redundancy comes from the other cells.

— all of these hold:
— the node's `stateless` is false
— the node sits inside exactly 1 availability-zone group
— this does not hold:
— the node sits inside at least one cell group

Use it in a design

nodes:
  - { id: "mwaa", component: "aws-mwaa" }

Other Workflow engine products · 44

CloudFlowalibaba-cloudflowalibabacloudworkflow-engine CloudOps Orchestration Servicealibaba-oosalibabacloudworkflow-engine Amazon Augmented AI (A2I)aws-augmented-aiawsworkflow-engine AWS Systems Manager Incident Manager and Change Manageraws-ssm-incident-and-change-managerawsworkflow-engine AWS Step Functionsaws-step-functionsawsworkflow-engine Amazon Simple Workflow Serviceaws-swfawsworkflow-engine Azure Durable Functionsazure-durable-functionsazureworkflow-engine Azure Logic Appsazure-logic-appsazureworkflow-engine Cloudflare Workflowscloudflare-workflowscloudflareworkflow-engine Apache Airflowairflowworkflow-engine Argo Workflowsargo-workflowsworkflow-engine Astronomer Astroastronomerworkflow-engine Cadencecadenceworkflow-engine Camunda 8camundaworkflow-engine Conductorconductorworkflow-engine Dagsterdagsterworkflow-engine Digdagdigdagworkflow-engine Flowableflowableworkflow-engine Inngestinngestworkflow-engine jBPMjbpmworkflow-engine Kestrakestraworkflow-engine Luigiluigiworkflow-engine n8nn8nworkflow-engine Node-REDnode-redworkflow-engine Prefectprefectworkflow-engine Prefect Cloudprefect-cloudworkflow-engine Restaterestateworkflow-engine Temporaltemporalworkflow-engine Temporal Cloudtemporal-cloudworkflow-engine Trigger.devtrigger-devworkflow-engine Windmillwindmillworkflow-engine Workatoworkatoworkflow-engine Generic workflow engineworkflow-engineworkflow-engine Zapierzapierworkflow-engine Application Integrationgoogle-application-integrationgcpworkflow-engine Cloud Composer (Managed Service for Apache Airflow)google-cloud-composergcpworkflow-engine Workflowsgoogle-cloud-workflowsgcpworkflow-engine Orchestration Pipelinesgoogle-orchestration-pipelinesgcpworkflow-engine IBM App Connectibm-app-connectibmworkflow-engine Oracle Integration 3oci-integrationociworkflow-engine

and 4 more → Workflow engine page

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# Amazon Managed Workflows for Apache Airflow: managed Airflow environment whose schedulers and workers run as
3# Fargate containers in an Amazon MWAA VPC, with data "automatically encrypted using AWS Key Management Service"
4# ("What Is Amazon Managed Workflows for Apache Airflow?"). Scheduler count defaults to 2 on every class above
5# mw1.micro ("Configuring the Amazon MWAA environment class") and Maximum worker count defaults to 10
6# ("Configuring Amazon MWAA worker automatic scaling").
7schemaVersion: "1"
8type: "component"
9id: "aws-mwaa"
10kind: "workflow-engine"
11provider: "aws"
12docs: "https://docs.aws.amazon.com/mwaa/latest/userguide/environment-class.html"
13aliases: ["MWAA"]
14defaults:
15  managed: true
16  durable: true
17  pattern: "dag"
18  stepsIdempotent: false
19  compensation: false
20  humanReview: false
21properties:
22  environmentClass:
23    type: "enum"
24    values: ["mw1-micro", "mw1-small", "mw1-medium", "mw1-large", "mw1-xlarge", "mw1-2xlarge"]
25  schedulerCount:
26    type: "integer"
27    default: 2
28  maxWorkers:
29    type: "integer"
30    default: 10
31  webserverAccessMode:
32    type: "enum"
33    values: ["public", "private"]

The same page as markdown, for an agent: /catalogue/components/aws-mwaa.md