Determined AI

ML platformdetermined

Open source deep learning platform scheduling distributed training and HPO on GPUs.

Provider
default
Category
Compute
Properties · 4 set by this component
propertytypevaluesrequiredkind defaultthis component
computeInstancesinteger—no—inherited
experimentTrackingboolean—notrue▸ true
framework · component propertyenumpytorch | tensorflowno—inherited
gpuEnabledboolean—no—▸ true
hyperparameterSearch · component propertyboolean—notrueinherited
managedboolean—nofalse▸ false
modelRegistryboolean—notrue▸ true
publicAccessboolean—no—inherited
resourceManager · component propertyenumagent | kubernetes | slurm | pbsno—inherited
Rules that apply · 1

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

stateful-node-without-zone-redundancy

A stateful compute node pinned to exactly one availability zone disappears with that zone, and its state goes with it. Nodes inside a cell are exempt, because there the cell is deliberately single-zone and redundancy comes from the other cells.

  • — all of these hold:
  • — the node's `stateless` is false
  • — the node sits inside exactly 1 availability-zone group
  • — this does not hold:
  • — the node sits inside at least one cell group
Use it in a design
nodes:
  - { id: "determined", component: "determined" }
Other ML platform products · 61and 21 more → ML platform page
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# Determined: open source deep learning platform, a master plus agents scheduling GPU training jobs.
# Facts from the Determined project README: Apache 2.0, self-deployed on-premises, on AWS or GCP,
# on Kubernetes or on Slurm/PBS HPC clusters; distributed training, HPO, tracking and model registry.
schemaVersion: "1"
type: "component"
id: "determined"
kind: "ml-platform"
provider: "default"
docs: "https://github.com/determined-ai/determined"
defaults:
  experimentTracking: true
  modelRegistry: true
  gpuEnabled: true
  managed: false
properties:
  resourceManager:
    type: "enum"
    values: ["agent", "kubernetes", "slurm", "pbs"]
  hyperparameterSearch:
    type: "boolean"
    default: true
  framework:
    type: "enum"
    values: ["pytorch", "tensorflow"]

The same page as markdown, for an agent: /catalogue/components/determined.md