Zeema
New design
Catalogue / ml-platform

Metaflow

ML platformmetaflow

Open source framework for ML flows with artifact versioning and run tracking.

Provider
default
Kind
ML platform
Category
Compute
Official docs
https://docs.metaflow.org/getting-started/infrastructure
Properties · 2 set by this component
propertytypevaluesrequiredkind defaultthis component
computeInstancesinteger—no—inherited
computeLayer · component propertyenumlocal | aws-batch | kubernetesnolocalinherited
datastore · component propertyenumlocal | s3 | azure-blob | gcsnolocalinherited
experimentTrackingboolean—notrue▸ true
gpuEnabledboolean—no—inherited
managedboolean—nofalse▸ false
metadataService · component propertyenumlocal | servicenolocalinherited
modelRegistryboolean—notrueinherited
publicAccessboolean—no—inherited
Rules that apply · 1

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

Stateful node without zone redundancyerror
stateful-node-without-zone-redundancy

A stateful compute node pinned to exactly one availability zone disappears with that zone, and its state goes with it. Nodes inside a cell are exempt, because there the cell is deliberately single-zone and redundancy comes from the other cells.

  • — all of these hold:
  • — the node's `stateless` is false
  • — the node sits inside exactly 1 availability-zone group
  • — this does not hold:
  • — the node sits inside at least one cell group
Use it in a design
nodes:
  - { id: "metaflow", component: "metaflow" }
Other ML platform products · 61
Platform for AIalibaba-paialibabacloudml-platformAWS Clean Rooms MLaws-clean-rooms-mlawsml-platformAmazon SageMaker AIaws-sagemakerawsml-platformAmazon SageMaker Canvasaws-sagemaker-canvasawsml-platformAmazon SageMaker Feature Storeaws-sagemaker-feature-storeawsml-platformManaged MLflow on Amazon SageMaker AIaws-sagemaker-mlflowawsml-platformAmazon SageMaker Unified Studioaws-sagemaker-unified-studioawsml-platformMicrosoft Foundryazure-ai-foundryazureml-platformAzure Machine Learningazure-machine-learningazureml-platformAbacus.AIabacus-aiml-platformAlteryxalteryxml-platformArgillaargillaml-platformC3 AI Platformc3-aiml-platformClearMLclearmlml-platformCometcomet-mlml-platformCVATcvatml-platformDataikudataikuml-platformDataRobotdatarobotml-platformDatasaurdatasaurml-platformDetermined AIdeterminedml-platformDomino Data Labdomino-data-labml-platformDVCdvcml-platformEncordencordml-platformFeastfeastml-platformFlyteflyteml-platformH2O.aih2oml-platformKilikiliml-platformKNIMEknimeml-platformKubeflowkubeflowml-platformLabel Studiolabel-studioml-platformLabelboxlabelboxml-platformGeneric ML platformml-platformml-platformMLflowmlflowml-platformneptune.aineptune-aiml-platformNVIDIA DGX Cloudnvidia-dgx-cloudml-platformPachydermpachydermml-platformPolyaxonpolyaxonml-platformProdigyprodigyml-platformRapidMiner AI Hubrapidminerml-platformRoboflowroboflowml-platform
and 21 more → ML platform page
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# Metaflow: open source framework and workspace for ML flows, artifact versioning and tracking.
# Defaults from "What is Metaflow" and "Infrastructure": the local stack keeps metadata and the
# datastore in local files; a cloud deployment adds a metadata service, blob datastore and compute.
schemaVersion: "1"
type: "component"
id: "metaflow"
kind: "ml-platform"
provider: "default"
docs: "https://docs.metaflow.org/getting-started/infrastructure"
defaults:
  experimentTracking: true
  managed: false
properties:
  metadataService:
    type: "enum"
    values: ["local", "service"]
    default: "local"
  datastore:
    type: "enum"
    values: ["local", "s3", "azure-blob", "gcs"]
    default: "local"
  computeLayer:
    type: "enum"
    values: ["local", "aws-batch", "kubernetes"]
    default: "local"

The same page as markdown, for an agent: /catalogue/components/metaflow.md