HDFS

Hadoop distributed file system with a NameNode and rack-aware replicated blocks on DataNodes.

Provider
default
Category
Data
Properties · 6 set by this component
propertytypevaluesrequiredkind defaultthis component
backupEnabledboolean—nofalse▸ false
blockSizeMib · component propertyinteger—no128inherited
encryptionInTransitboolean—no—▸ false
managedboolean—nofalse▸ false
protocolenumnfs | smb | multi | lustre | nativeyes—▸ native
publicAccessboolean—no—▸ false
quotaGibinteger—no—inherited
redundancyenumlocal | zonal | regionalno—▸ local
replicationFactor · component propertyinteger—no3inherited
transparentEncryptionZone · component propertyboolean—nofalseinherited
Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.
Use it in a design
nodes:
  - { id: "hdfs", component: "hdfs" }
Other File share products · 35
Apsara File Storage for HDFSalibaba-file-storage-hdfsalibabacloudfile-storageApsara File Storage NASalibaba-nasalibabacloudfile-storageAmazon EFSaws-efsawsfile-storageAmazon File Cacheaws-file-cacheawsfile-storageAmazon FSx for Lustreaws-fsx-lustreawsfile-storageAmazon FSx for NetApp ONTAPaws-fsx-ontapawsfile-storageAmazon FSx for OpenZFSaws-fsx-openzfsawsfile-storageAmazon FSx for Windows File Serveraws-fsx-windowsawsfile-storageAzure File Syncazure-file-syncazurefile-storageAzure Filesazure-filesazurefile-storageAzure Managed Lustreazure-managed-lustreazurefile-storageAzure NetApp Filesazure-netapp-filesazurefile-storageBeeGFSbeegfsfile-storageCephFScephfsfile-storageCubeFScubefsfile-storageCurvinecurvinefile-storageGeneric file sharefile-storagefile-storageFile storefile-storefile-storageGlusterFSglusterfsfile-storageJuiceFSjuicefsfile-storageLustrelustrefile-storageMooseFSmoosefsfile-storageNextcloudnextcloudfile-storageNFS servernfs-serverfile-storageSambasambafile-storageDigitalOcean Network File Storagedigitalocean-nfsdigitaloceanfile-storageFilestoregoogle-filestoregcpfile-storageGoogle Cloud Managed Lustregoogle-managed-lustregcpfile-storageGoogle Cloud NetApp Volumesgoogle-netapp-volumesgcpfile-storageParallelstoregoogle-parallelstoregcpfile-storageFile Storage for VPCibm-file-storageibmfile-storageFile Storage for Classicibm-file-storage-classicibmfile-storageOCI File Storageoci-file-storageocifile-storageOCI File Storage with Lustreoci-file-storage-lustreocifile-storageOpenStack Manilaopenstack-manilaopenstackfile-storage
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# HDFS: the Hadoop distributed file system, a NameNode plus DataNodes holding rack-aware block replicas ("HDFS Architecture").
# hdfs-default.xml: dfs.replication 3, dfs.blocksize 134217728, dfs.encrypt.data.transfer false; transparent encryption zones are opt-in.
schemaVersion: "1"
type: "component"
id: "hdfs"
kind: "file-storage"
provider: "default"
docs: "https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/hdfs-default.xml"
defaults:
  protocol: "native"
  managed: false
  publicAccess: false
  encryptionInTransit: false
  backupEnabled: false
  redundancy: "local"
properties:
  replicationFactor:
    type: "integer"
    default: 3
  blockSizeMib:
    type: "integer"
    default: 128
  transparentEncryptionZone:
    type: "boolean"
    default: false

The same page as markdown, for an agent: /catalogue/components/hdfs.md