Zeema
New design
Catalogue / data-catalog

Amundsen

Data catalogamundsen

Open-source data discovery engine that searches metadata built by databuilder ETL jobs.

Provider
default
Kind
Data catalog
Category
Data
Official docs
https://github.com/amundsen-io/amundsen
Properties · 4 set by this component
propertytypevaluesrequiredkind defaultthis component
accessPolicyEnforcementboolean—no—▸ false
classificationboolean—no—▸ false
ingestionOrchestrator · component propertyenumairflow | scriptnoairflowinherited
lineageboolean—no—inherited
managedboolean—nofalse▸ false
metadataBackend · component propertyenumneo4j | atlasnoneo4jinherited
scanScheduleenummanual | daily | weeklyno—▸ manual
searchBackend · component propertyenumelasticsearch | atlasnoelasticsearchinherited
sourceCountinteger—no—inherited
Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.
Use it in a design
nodes:
  - { id: "amundsen", component: "amundsen" }
Other Data catalog products · 23
AWS Application Discovery Serviceaws-application-discovery-serviceawsdata-catalogAmazon DataZoneaws-datazoneawsdata-catalogAWS Glue Data Catalogaws-glue-data-catalogawsdata-catalogAzure API Centerazure-api-centerazuredata-catalogMicrosoft Purviewazure-purviewazuredata-catalogR2 Data Catalogcloudflare-r2-data-catalogcloudflaredata-catalogAlationalationdata-catalogApache Atlasatlasdata-catalogCollibracollibradata-catalogGeneric data catalogdata-catalogdata-catalogDataHubdatahubdata-catalogOpenMetadataopenmetadatadata-catalogApache Polarispolarisdata-catalogUnity Catalogunity-catalogdata-catalogAgent Registrygoogle-agent-registrygcpdata-catalogBigQuery sharing (Analytics Hub)google-analytics-hubgcpdata-catalogBigLakegoogle-biglakegcpdata-catalogCloud API Registrygoogle-cloud-api-registrygcpdata-catalogCloud Asset Inventorygoogle-cloud-asset-inventorygcpdata-catalogDataplex Universal Cataloggoogle-dataplexgcpdata-catalogDataproc Metastoregoogle-dataproc-metastoregcpdata-catalogIBM Data Product Hubibm-data-product-hubibmdata-catalogOCI Data Catalogoci-data-catalogocidata-catalog
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# Amundsen: open-source data discovery and metadata engine from Lyft.
# README: five services (frontend, search on Elasticsearch, metadata on Neo4j or Apache Atlas,
# databuilder, common); metadata arrives from databuilder ETL jobs a team schedules itself,
# usually as Airflow DAGs, so there is no built-in scan schedule.
schemaVersion: "1"
type: "component"
id: "amundsen"
kind: "data-catalog"
provider: "default"
docs: "https://github.com/amundsen-io/amundsen"
defaults:
  managed: false
  scanSchedule: "manual"
  classification: false
  accessPolicyEnforcement: false
properties:
  metadataBackend:
    type: "enum"
    values: ["neo4j", "atlas"]
    default: "neo4j"
  searchBackend:
    type: "enum"
    values: ["elasticsearch", "atlas"]
    default: "elasticsearch"
  ingestionOrchestrator:
    type: "enum"
    values: ["airflow", "script"]
    default: "airflow"

The same page as markdown, for an agent: /catalogue/components/amundsen.md