Deepchecks
Monitoringdeepchecks
LLM evaluation and monitoring platform as SaaS, in your VPC or as a SageMaker partner app.
- Provider
- default
- Kind
- Monitoring
- Category
- Operations
- Official docs
- https://llmdocs.deepchecks.com/docs/aws-sagemaker
| property | type | values | required | kind default | this component |
|---|---|---|---|---|---|
| alertGrouping | boolean | — | no | false | inherited |
| collectorMode | enum | pull | push | no | pull | ▸ push |
| deployment | enum | saas | vpc | on-premise | sagemaker-partner-app | no | saas | inherited |
| independentOfMonitored | boolean | — | no | false | ▸ true |
| managed | boolean | — | no | false | ▸ true |
| retentionDays | integer | — | no | — | inherited |
| signal | enum | metrics | logs | traces | alerts | all | no | metrics | ▸ traces |
Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.
No rule reads this kind yet. That is a gap, not a guarantee.
nodes:
- { id: "deepchecks", component: "deepchecks" }ActionTrailalibaba-actiontrailApplication Real-Time Monitoring Servicealibaba-armsCloudMonitoralibaba-cloud-monitorDatabase Autonomy Servicealibaba-dasSimple Log Servicealibaba-log-serviceSecurity Centeralibaba-security-centerAmazon CloudWatch investigationsaws-aiopsAWS Audit Manageraws-audit-managerAWS CloudTrailaws-cloudtrailAWS CloudTrail Lakeaws-cloudtrail-lakeAmazon CloudWatch Application Insightsaws-cloudwatch-application-insightsAmazon CloudWatch Application Signalsaws-cloudwatch-application-signalsAmazon CloudWatch Internet Monitoraws-cloudwatch-internet-monitorAmazon CloudWatch Logsaws-cloudwatch-logsAmazon CloudWatch Network Flow Monitoraws-cloudwatch-network-flow-monitorAmazon CloudWatch Network Monitoraws-cloudwatch-network-monitorAmazon CloudWatch RUMaws-cloudwatch-rumAmazon CloudWatch Syntheticsaws-cloudwatch-syntheticsAmazon CodeGuru Profileraws-codeguru-profilerAWS Compute Optimizeraws-compute-optimizerAmazon Detectiveaws-detectiveAmazon DevOps Guruaws-devops-guruAmazon GuardDutyaws-guarddutyAmazon Inspectoraws-inspectorAWS IoT Device Defenderaws-iot-device-defenderAmazon Macieaws-macieAmazon Managed Grafanaaws-managed-grafanaAmazon Managed Service for Prometheusaws-managed-prometheusAWS Migration Hubaws-migration-hubAWS Resilience Hubaws-resilience-hubAWS Security Hub CSPMaws-security-hubAWS Security Incident Responseaws-security-incident-responseAWS Trusted Advisoraws-trusted-advisorAWS X-Rayaws-xrayAmazon CloudWatchcloudwatchAzure Advisorazure-advisorApplication Insightsazure-application-insightsMicrosoft Defender External Attack Surface Managementazure-defender-easmMicrosoft Defender for Cloudazure-defender-for-cloudMicrosoft Defender for IoTazure-defender-for-iot
and 134 more → Monitoring page# yaml-language-server: $schema=../../schema/component.schema.json # Deepchecks: LLM evaluation and monitoring platform that scores, compares and monitors prompts, models and agents. # Deepchecks runs as managed SaaS, in a VPC on GCP or Azure, on-premise, or as an Amazon SageMaker Partner AI App inside # the customer's AWS account. The open-source deepchecks testing package has had no release since December 2024. schemaVersion: "1" type: "component" id: "deepchecks" kind: "monitoring" provider: "default" docs: "https://llmdocs.deepchecks.com/docs/aws-sagemaker" defaults: managed: true signal: "traces" collectorMode: "push" independentOfMonitored: true properties: deployment: type: "enum" values: ["saas", "vpc", "on-premise", "sagemaker-partner-app"] default: "saas"