OCI Connector Hub

ociStream processoroci-connector-hub

Managed source-task-target bus that moves logs, metrics, streams and queue messages between OCI services.

Provider
oci
Category
Messaging
Also known as
Service Connector Hub
Properties · 3 set by this component
propertytypevaluesrequiredkind defaultthis component
checkpointIntervalSecondsinteger—no—inherited
exactlyOnceboolean—nofalse▸ false
instancesinteger—no—inherited
lateDataPolicyenumdrop | shift | sidelineno—inherited
managedboolean—nofalse▸ true
source · component propertyenumlogging | monitoring | streaming | queueno—inherited
stateBackendenummemory | rocksdb | externalnomemoryinherited
target · component propertyenumobject-storage | streaming | monitoring | logging-analytics | notifications | functionsno—inherited
taskFilter · component propertyboolean—nofalseinherited
taskFunction · component propertyboolean—nofalseinherited
watermarkSecondsinteger—no—inherited
windowingenumnone | event-time | processing-timenonone▸ none
Rules that apply · 1

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

windowed-aggregation-without-watermark

Event-time windows need a watermark to know when a window is complete. Without one the processor either waits forever or closes windows early and silently drops late events.

  • — all of these hold:
  • — the node's `windowing` is "event-time"
  • — the node's `watermarkSeconds` has no value
Use it in a design
nodes:
  - { id: "connector-hub", component: "oci-connector-hub" }
Other Stream processor products · 33
Realtime Compute for Apache Flinkalibaba-flinkalibabacloudstream-processorAmazon EventBridge Pipesaws-eventbridge-pipesawsstream-processorAmazon Data Firehoseaws-firehoseawsstream-processorAmazon Managed Service for Apache Flinkaws-managed-flinkawsstream-processorAmazon OpenSearch Ingestionaws-opensearch-ingestionawsstream-processorAzure Stream Analyticsazure-stream-analyticsazurestream-processorCloudflare Logpushcloudflare-logpushcloudflarestream-processorCloudflare Pipelinescloudflare-pipelinescloudflarestream-processorArroyoarroyostream-processorApache Beambeamstream-processorBytewaxbytewaxstream-processorDrasidrasistream-processorApache Flinkflinkstream-processorKafka Streamskafka-streamsstream-processorksqlDBksqldbstream-processorLogstashlogstashstream-processorMaterializematerializestream-processorApache NiFinifistream-processorNorikranorikrastream-processorRedpanda Connectredpanda-connectstream-processorRisingWaverisingwavestream-processorApache Samzasamzastream-processorSnowplowsnowplowstream-processorSpark Structured Streamingspark-streamingstream-processorApache Stormstormstream-processorGeneric stream processorstream-processorstream-processorTremortremorstream-processorGoogle Cloud Dataflowgoogle-dataflowgcpstream-processorManufacturing Data Enginegoogle-manufacturing-data-enginegcpstream-processorActivity Tracker Event Routingibm-activity-tracker-event-routingibmstream-processorIBM Cloud Logs Routingibm-logs-routingibmstream-processorIBM Cloud Metrics Routingibm-metrics-routingibmstream-processorOCI GoldenGate Stream Analyticsoci-goldengate-stream-analyticsocistream-processor
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# OCI Connector Hub (formerly Service Connector Hub): managed source-task-target message bus that
# moves logs, metrics, streams and queue messages between OCI services, with optional log filtering
# and function tasks in between. Facts from "Connector Hub" service documentation home.
schemaVersion: "1"
type: "component"
id: "oci-connector-hub"
kind: "stream-processor"
provider: "oci"
docs: "https://docs.oracle.com/en-us/iaas/Content/connector-hub/home.htm"
aliases: ["Service Connector Hub"]
defaults:
  managed: true
  windowing: "none"
  exactlyOnce: false
properties:
  source:
    type: "enum"
    values: ["logging", "monitoring", "streaming", "queue"]
  target:
    type: "enum"
    values: ["object-storage", "streaming", "monitoring", "logging-analytics", "notifications", "functions"]
  taskFilter:
    type: "boolean"
    default: false
  taskFunction:
    type: "boolean"
    default: false

The same page as markdown, for an agent: /catalogue/components/oci-connector-hub.md