AWS Glue Data Catalog

Central metadata repository of databases, tables and partitions for AWS analytics services.

Provider: aws
Kind: Data catalog
Category: Data
Official docs: https://docs.aws.amazon.com/glue/latest/dg/catalog-and-crawler.html

Properties · 4 set by this component

property	type	values	required	kind default	this component
accessPolicyEnforcement	boolean	—	no	—	▸ false
classification	boolean	—	no	—	inherited
columnStatistics · component property	boolean	—	no	false	inherited
icebergCompaction · component property	boolean	—	no	false	inherited
lineage	boolean	—	no	—	▸ true
managed	boolean	—	no	false	▸ true
metadataEncryption · component property	boolean	—	no	false	inherited
scanSchedule	enum	manual \| daily \| weekly	no	—	▸ manual
sourceCount	integer	—	no	—	inherited

Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.

Use it in a design

nodes:
  - { id: "glue-data-catalog", component: "aws-glue-data-catalog" }

Other Data catalog products · 23

AWS Application Discovery Serviceaws-application-discovery-serviceawsdata-catalog Amazon DataZoneaws-datazoneawsdata-catalog Azure API Centerazure-api-centerazuredata-catalog Microsoft Purviewazure-purviewazuredata-catalog R2 Data Catalogcloudflare-r2-data-catalogcloudflaredata-catalog Alationalationdata-catalog Amundsenamundsendata-catalog Apache Atlasatlasdata-catalog Collibracollibradata-catalog Generic data catalogdata-catalogdata-catalog DataHubdatahubdata-catalog OpenMetadataopenmetadatadata-catalog Apache Polarispolarisdata-catalog Unity Catalogunity-catalogdata-catalog Agent Registrygoogle-agent-registrygcpdata-catalog BigQuery sharing (Analytics Hub)google-analytics-hubgcpdata-catalog BigLakegoogle-biglakegcpdata-catalog Cloud API Registrygoogle-cloud-api-registrygcpdata-catalog Cloud Asset Inventorygoogle-cloud-asset-inventorygcpdata-catalog Dataplex Universal Cataloggoogle-dataplexgcpdata-catalog Dataproc Metastoregoogle-dataproc-metastoregcpdata-catalog IBM Data Product Hubibm-data-product-hubibmdata-catalog OCI Data Catalogoci-data-catalogocidata-catalog

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# AWS Glue Data Catalog: the managed metadata repository for the account's data estate; it keeps schema versions
3# and "maintains a record of the transformations and operations performed on your data, providing data lineage"
4# ("Data discovery and cataloging in AWS Glue"). It is populated on demand by crawlers or by hand, fine-grained
5# access control comes from Lake Formation, and metadata encryption is opt-in ("Encrypting your Data Catalog").
6schemaVersion: "1"
7type: "component"
8id: "aws-glue-data-catalog"
9kind: "data-catalog"
10provider: "aws"
11docs: "https://docs.aws.amazon.com/glue/latest/dg/catalog-and-crawler.html"
12defaults:
13  managed: true
14  scanSchedule: "manual"
15  lineage: true
16  accessPolicyEnforcement: false
17properties:
18  metadataEncryption:
19    type: "boolean"
20    default: false
21  columnStatistics:
22    type: "boolean"
23    default: false
24  icebergCompaction:
25    type: "boolean"
26    default: false

The same page as markdown, for an agent: /catalogue/components/aws-glue-data-catalog.md