Apache Ozone

Scalable object store for Hadoop with three-way Ratis replication or erasure-coded buckets.

Provider: default
Kind: Object store
Category: Data
Official docs: https://ozone.apache.org/docs/current/feature/erasurecoding.html

Properties · 5 set by this component

property	type	values	required	kind default	this component
checksumOnWrite · advanced	boolean	—	no	false	inherited
datanodeReplicas · component property	integer	—	no	3	inherited
durabilityNines · advanced	integer	—	no	—	inherited
encryptionAtRest	boolean	—	no	false	▸ false
managed	boolean	—	no	false	▸ false
objectLock	boolean	—	no	false	inherited
replication	enum	none \| primary-secondary \| quorum \| erasure-coded	no	none	▸ quorum
replicationConfig · component property	enum	ratis-three \| rs-3-2-1024k \| rs-6-3-1024k \| rs-10-4-1024k	no	ratis-three	inherited
s3Gateway · component property	boolean	—	no	false	inherited
strongReadAfterWrite · advanced	boolean	—	no	false	▸ true
tier	enum	hot \| warm \| cold	no	hot	inherited
transparentEncryption · component property	boolean	—	no	false	inherited
versioning	boolean	—	no	false	▸ false
zones	integer	—	no	—	inherited

Rules that apply · 1

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

Object store in fewer than three zones with a durability targeterror

object-store-single-zone-with-durability-target

Eleven nines of durability assumes redundancy spread over at least three failure domains. An object store confined to fewer zones, or declaring none, cannot reach the target the design states.

— all of these hold:
— the design requirement `durability.annualNines` is a number greater than 10
— any of these hold:
— the node's `zones` has no value
— the node's `zones` is a number less than 3

Use it in a design

nodes:
  - { id: "ozone", component: "ozone" }

Other Object store products · 32

Object Storage Servicealibaba-ossalibabacloudobject-store AWS HealthImagingaws-healthimagingawsobject-store AWS HealthOmicsaws-healthomicsawsobject-store Amazon S3 Express One Zoneaws-s3-express-one-zoneawsobject-store Amazon S3 Glacieraws-s3-glacierawsobject-store Amazon S3 Tablesaws-s3-tablesawsobject-store Amazon Security Lakeaws-security-lakeawsobject-store Amazon S3s3awsobject-store Azure Blob Storageazure-blob-storageazureobject-store Azure Data Lake Storageazure-data-lake-storageazureobject-store Microsoft Planetary Computer Proazure-planetary-computerazureobject-store Cache Reservecloudflare-cache-reservecloudflareobject-store Cloudflare Imagescloudflare-imagescloudflareobject-store Cloudflare R2cloudflare-r2cloudflareobject-store Backblaze B2 Cloud Storagebackblaze-b2object-store Blob storeblob-storeobject-store Ceph RADOS Gatewayceph-rgwobject-store Cloudinarycloudinaryobject-store Garagegarageobject-store lakeFSlakefsobject-store MinIOminioobject-store Generic object storeobject-storeobject-store SeaweedFSseaweedfsobject-store Storjstorjobject-store OpenStack Swiftswiftobject-store Wasabi Hot Cloud Storagewasabiobject-store Spaces Object Storagedigitalocean-spacesdigitaloceanobject-store Google Cloud Storagegcsgcpobject-store IBM Cloud Object Storageibm-cloud-object-storageibmobject-store OCI Archive Storageoci-archive-storageociobject-store OCI Object Storageoci-object-storageociobject-store OUTSCALE Object Storage (OOS)outscale-oosoutscaleobject-store

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# Apache Ozone: self-hosted scalable object store for Hadoop with S3 and ofs interfaces.
3# Per "Ozone Erasure Coding", RATIS/THREE is the default replication scheme and writes every block to
4# three datanodes for a 200% storage overhead; erasure coding (RS-3-2-1024k, RS-6-3-1024k, RS-10-4-1024k)
5# is opt-in and configured per bucket, and new keys inherit the bucket's replication config.
6schemaVersion: "1"
7type: "component"
8id: "ozone"
9kind: "object-store"
10provider: "default"
11docs: "https://ozone.apache.org/docs/current/feature/erasurecoding.html"
12defaults:
13  managed: false
14  replication: "quorum"
15  strongReadAfterWrite: true
16  versioning: false
17  encryptionAtRest: false
18properties:
19  replicationConfig:
20    type: "enum"
21    values: ["ratis-three", "rs-3-2-1024k", "rs-6-3-1024k", "rs-10-4-1024k"]
22    default: "ratis-three"
23  datanodeReplicas:
24    type: "integer"
25    default: 3
26  s3Gateway:
27    type: "boolean"
28    default: false
29  transparentEncryption:
30    type: "boolean"
31    default: false

The same page as markdown, for an agent: /catalogue/components/ozone.md