Zeema
New design
Catalogue / data-catalog

Apache Atlas

Data catalogatlas

Hadoop data governance framework with a type system, propagating classifications and hook-based lineage.

Provider
default
Kind
Data catalog
Category
Data
Official docs
https://atlas.apache.org/2.0.0/index.html
Properties · 4 set by this component
propertytypevaluesrequiredkind defaultthis component
accessPolicyEnforcementboolean—no—▸ false
classificationboolean—no—▸ true
classificationPropagation · component propertyboolean—notrueinherited
hookBasedIngestion · component propertyboolean—notrueinherited
lineageboolean—no—▸ true
managedboolean—nofalse▸ false
rangerIntegration · component propertyboolean—nofalseinherited
scanScheduleenummanual | daily | weeklyno—inherited
searchLanguage · component propertyenumdsl | full-text | basicno—inherited
sourceCountinteger—no—inherited
Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.
Use it in a design
nodes:
  - { id: "atlas", component: "atlas" }
Other Data catalog products · 23
AWS Application Discovery Serviceaws-application-discovery-serviceawsdata-catalogAmazon DataZoneaws-datazoneawsdata-catalogAWS Glue Data Catalogaws-glue-data-catalogawsdata-catalogAzure API Centerazure-api-centerazuredata-catalogMicrosoft Purviewazure-purviewazuredata-catalogR2 Data Catalogcloudflare-r2-data-catalogcloudflaredata-catalogAlationalationdata-catalogAmundsenamundsendata-catalogCollibracollibradata-catalogGeneric data catalogdata-catalogdata-catalogDataHubdatahubdata-catalogOpenMetadataopenmetadatadata-catalogApache Polarispolarisdata-catalogUnity Catalogunity-catalogdata-catalogAgent Registrygoogle-agent-registrygcpdata-catalogBigQuery sharing (Analytics Hub)google-analytics-hubgcpdata-catalogBigLakegoogle-biglakegcpdata-catalogCloud API Registrygoogle-cloud-api-registrygcpdata-catalogCloud Asset Inventorygoogle-cloud-asset-inventorygcpdata-catalogDataplex Universal Cataloggoogle-dataplexgcpdata-catalogDataproc Metastoregoogle-dataproc-metastoregcpdata-catalogIBM Data Product Hubibm-data-product-hubibmdata-catalogOCI Data Catalogoci-data-catalogocidata-catalog
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# Apache Atlas: data governance and metadata framework for Hadoop.
# Atlas overview: classifications such as PII are first-class and propagate along lineage,
# lineage is captured from hooks on the processing engines, and authorization or data masking
# on the source happens only once Apache Ranger is integrated.
schemaVersion: "1"
type: "component"
id: "atlas"
kind: "data-catalog"
provider: "default"
docs: "https://atlas.apache.org/2.0.0/index.html"
defaults:
  managed: false
  classification: true
  lineage: true
  accessPolicyEnforcement: false
properties:
  classificationPropagation:
    type: "boolean"
    default: true
  rangerIntegration:
    type: "boolean"
    default: false
  searchLanguage:
    type: "enum"
    values: ["dsl", "full-text", "basic"]
  hookBasedIngestion:
    type: "boolean"
    default: true

The same page as markdown, for an agent: /catalogue/components/atlas.md