Confident AI

Monitoringconfident-ai

SaaS evaluation and observability for LLM applications, built on DeepEval.

Provider
default
Category
Operations
Properties · 4 set by this component
propertytypevaluesrequiredkind defaultthis component
alertGroupingboolean—nofalseinherited
collectorModeenumpull | pushnopull▸ push
independentOfMonitoredboolean—nofalse▸ true
managedboolean—nofalse▸ true
plan · component propertyenumfree | starter | team | enterprisenofreeinherited
region · component propertyenumus | euno—inherited
retentionDaysinteger—no—inherited
selfHosted · component propertyboolean—nofalseinherited
signalenummetrics | logs | traces | alerts | allnometrics▸ traces
Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.
Use it in a design
nodes:
  - { id: "confident-ai", component: "confident-ai" }
Other Monitoring products · 174
ActionTrailalibaba-actiontrailalibabacloudmonitoringApplication Real-Time Monitoring Servicealibaba-armsalibabacloudmonitoringCloudMonitoralibaba-cloud-monitoralibabacloudmonitoringDatabase Autonomy Servicealibaba-dasalibabacloudmonitoringSimple Log Servicealibaba-log-servicealibabacloudmonitoringSecurity Centeralibaba-security-centeralibabacloudmonitoringAmazon CloudWatch investigationsaws-aiopsawsmonitoringAWS Audit Manageraws-audit-managerawsmonitoringAWS CloudTrailaws-cloudtrailawsmonitoringAWS CloudTrail Lakeaws-cloudtrail-lakeawsmonitoringAmazon CloudWatch Application Insightsaws-cloudwatch-application-insightsawsmonitoringAmazon CloudWatch Application Signalsaws-cloudwatch-application-signalsawsmonitoringAmazon CloudWatch Internet Monitoraws-cloudwatch-internet-monitorawsmonitoringAmazon CloudWatch Logsaws-cloudwatch-logsawsmonitoringAmazon CloudWatch Network Flow Monitoraws-cloudwatch-network-flow-monitorawsmonitoringAmazon CloudWatch Network Monitoraws-cloudwatch-network-monitorawsmonitoringAmazon CloudWatch RUMaws-cloudwatch-rumawsmonitoringAmazon CloudWatch Syntheticsaws-cloudwatch-syntheticsawsmonitoringAmazon CodeGuru Profileraws-codeguru-profilerawsmonitoringAWS Compute Optimizeraws-compute-optimizerawsmonitoringAmazon Detectiveaws-detectiveawsmonitoringAmazon DevOps Guruaws-devops-guruawsmonitoringAmazon GuardDutyaws-guarddutyawsmonitoringAmazon Inspectoraws-inspectorawsmonitoringAWS IoT Device Defenderaws-iot-device-defenderawsmonitoringAmazon Macieaws-macieawsmonitoringAmazon Managed Grafanaaws-managed-grafanaawsmonitoringAmazon Managed Service for Prometheusaws-managed-prometheusawsmonitoringAWS Migration Hubaws-migration-hubawsmonitoringAWS Resilience Hubaws-resilience-hubawsmonitoringAWS Security Hub CSPMaws-security-hubawsmonitoringAWS Security Incident Responseaws-security-incident-responseawsmonitoringAWS Trusted Advisoraws-trusted-advisorawsmonitoringAWS X-Rayaws-xrayawsmonitoringAmazon CloudWatchcloudwatchawsmonitoringAzure Advisorazure-advisorazuremonitoringApplication Insightsazure-application-insightsazuremonitoringMicrosoft Defender External Attack Surface Managementazure-defender-easmazuremonitoringMicrosoft Defender for Cloudazure-defender-for-cloudazuremonitoringMicrosoft Defender for IoTazure-defender-for-iotazuremonitoring
and 134 more → Monitoring page
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# Confident AI: SaaS evaluation and observability platform built on the DeepEval framework. Per "What is
# Confident AI?", it ingests traces from instrumented applications, runs in US or EU regions and can be
# self-hosted with Docker on AWS, Azure or GCP; per "Pricing", the Free tier allows 5 test runs a week.
schemaVersion: "1"
type: "component"
id: "confident-ai"
kind: "monitoring"
provider: "default"
docs: "https://www.confident-ai.com/docs"
defaults:
  managed: true
  signal: "traces"
  collectorMode: "push"
  independentOfMonitored: true
properties:
  plan:
    type: "enum"
    values: ["free", "starter", "team", "enterprise"]
    default: "free"
  region:
    type: "enum"
    values: ["us", "eu"]
  selfHosted:
    type: "boolean"
    default: false

The same page as markdown, for an agent: /catalogue/components/confident-ai.md