Dataproc Metastore

gcp Data cataloggoogle-dataproc-metastore

Fully managed Apache Hive metastore for Spark, Hive and Presto workloads.

Provider: gcp
Kind: Data catalog
Category: Data
Official docs: https://docs.cloud.google.com/dataproc-metastore/docs/service-tier

Properties · 1 set by this component

property	type	values	required	kind default	this component
accessPolicyEnforcement	boolean	—	no	—	inherited
classification	boolean	—	no	—	inherited
databaseType · component property	enum	mysql \| spanner	no	mysql	inherited
endpointProtocol · component property	enum	thrift \| grpc	no	thrift	inherited
lineage	boolean	—	no	—	inherited
managed	boolean	—	no	false	▸ true
scanSchedule	enum	manual \| daily \| weekly	no	—	inherited
sourceCount	integer	—	no	—	inherited
tier · component property	enum	developer \| enterprise	no	developer	inherited

Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.

Use it in a design

nodes:
  - { id: "dataproc-metastore", component: "google-dataproc-metastore" }

Other Data catalog products · 23

AWS Application Discovery Serviceaws-application-discovery-serviceawsdata-catalog Amazon DataZoneaws-datazoneawsdata-catalog AWS Glue Data Catalogaws-glue-data-catalogawsdata-catalog Azure API Centerazure-api-centerazuredata-catalog Microsoft Purviewazure-purviewazuredata-catalog R2 Data Catalogcloudflare-r2-data-catalogcloudflaredata-catalog Alationalationdata-catalog Amundsenamundsendata-catalog Apache Atlasatlasdata-catalog Collibracollibradata-catalog Generic data catalogdata-catalogdata-catalog DataHubdatahubdata-catalog OpenMetadataopenmetadatadata-catalog Apache Polarispolarisdata-catalog Unity Catalogunity-catalogdata-catalog Agent Registrygoogle-agent-registrygcpdata-catalog BigQuery sharing (Analytics Hub)google-analytics-hubgcpdata-catalog BigLakegoogle-biglakegcpdata-catalog Cloud API Registrygoogle-cloud-api-registrygcpdata-catalog Cloud Asset Inventorygoogle-cloud-asset-inventorygcpdata-catalog Dataplex Universal Cataloggoogle-dataplexgcpdata-catalog IBM Data Product Hubibm-data-product-hubibmdata-catalog OCI Data Catalogoci-data-catalogocidata-catalog

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# Dataproc Metastore: fully managed Apache Hive metastore for Spark, Hive and Presto workloads.
3# "Dataproc Metastore service tiers" and "Database types": new services are created with the
4# Developer tier and a MySQL backing database; the Thrift endpoint is the default protocol.
5schemaVersion: "1"
6type: "component"
7id: "google-dataproc-metastore"
8kind: "data-catalog"
9provider: "gcp"
10docs: "https://docs.cloud.google.com/dataproc-metastore/docs/service-tier"
11defaults:
12  managed: true
13properties:
14  tier:
15    type: "enum"
16    values: ["developer", "enterprise"]
17    default: "developer"
18  databaseType:
19    type: "enum"
20    values: ["mysql", "spanner"]
21    default: "mysql"
22  endpointProtocol:
23    type: "enum"
24    values: ["thrift", "grpc"]
25    default: "thrift"

The same page as markdown, for an agent: /catalogue/components/google-dataproc-metastore.md