IBM watsonx.data

ibmData warehouseibm-watsonx-data

Lakehouse that queries Iceberg, Delta Lake and Hudi tables in object storage through Presto, Spark or Gluten engines.

Provider
ibm
Category
Data
Properties · 2 set by this component
propertytypevaluesrequiredkind defaultthis component
engine · component propertyenumpresto-java | presto-cpp | spark | glutenno—inherited
federation · component propertyboolean—notrueinherited
formatenumcolumnar | rownocolumnar▸ columnar
managedboolean—nofalse▸ true
realtimeboolean—nofalseinherited
tableFormat · component propertyenumiceberg | delta-lake | hudino—inherited
upsertboolean—nofalseinherited
Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.
Use it in a design
nodes:
  - { id: "watsonx-data", component: "ibm-watsonx-data" }
Other Data warehouse products · 39
AnalyticDBalibaba-analyticdbalibabaclouddata-warehouseApsaraDB for ClickHousealibaba-clickhousealibabaclouddata-warehouseHologresalibaba-hologresalibabaclouddata-warehouseMaxComputealibaba-maxcomputealibabaclouddata-warehouseApsaraDB for SelectDBalibaba-selectdbalibabaclouddata-warehouseAmazon Athenaaws-athenaawsdata-warehouseAmazon Redshiftredshiftawsdata-warehouseAzure Analysis Servicesazure-analysis-servicesazuredata-warehouseMicrosoft Fabricazure-fabricazuredata-warehouseAzure Synapse Analyticsazure-synapseazuredata-warehouseR2 SQLcloudflare-r2-sqlcloudflaredata-warehouseClickHouseclickhousedata-warehouseGeneric data warehousedata-warehousedata-warehouseDatabricks SQLdatabricks-sqldata-warehouseApache Dorisdorisdata-warehouseDremiodremiodata-warehouseApache Drilldrilldata-warehouseApache Druiddruiddata-warehouseDuckDBduckdbdata-warehouseExasolexasoldata-warehouseFireboltfireboltdata-warehouseGreenplumgreenplumdata-warehouseApache Hivehivedata-warehouseApache Impalaimpaladata-warehouseApache Kylinkylindata-warehouseMonetDBmonetdbdata-warehouseMotherDuckmotherduckdata-warehouseApache Pinotpinotdata-warehousePrestoprestodata-warehouseSnowflakesnowflakedata-warehouseStarRocksstarrocksdata-warehouseTeradata Vantageteradatadata-warehouseTrinotrinodata-warehouseVerticaverticadata-warehouseGoogle BigQuerybigquerygcpdata-warehouseDb2 Warehouse as a Serviceibm-db2-warehouseibmdata-warehouseNetezza Performance Server as a Serviceibm-netezzaibmdata-warehouseAutonomous AI Lakehouseoci-autonomous-data-warehouseocidata-warehouseMySQL HeatWave clusteroci-mysql-heatwave-clusterocidata-warehouse
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# IBM watsonx.data: a lakehouse that queries data where it lies. It offers Presto (Java), Presto
# (C++), a native Spark engine and Apache Gluten; it reads Apache Iceberg, Delta Lake and Apache
# Hudi tables; and the data sits in Cloud Object Storage, S3, ADLS, GCS, Ozone, HDFS or MinIO
# ("IBM watsonx.data"). Storage is external, so the component records the engine and table format.
schemaVersion: "1"
type: "component"
id: "ibm-watsonx-data"
kind: "data-warehouse"
provider: "ibm"
docs: "https://cloud.ibm.com/docs/watsonxdata"
defaults:
  managed: true
  format: "columnar"
properties:
  engine:
    type: "enum"
    values: ["presto-java", "presto-cpp", "spark", "gluten"]
  tableFormat:
    type: "enum"
    values: ["iceberg", "delta-lake", "hudi"]
  federation:
    type: "boolean"
    default: true

The same page as markdown, for an agent: /catalogue/components/ibm-watsonx-data.md