Zeema
New design
Catalogue / monitoring

LangSmith

Monitoringlangsmith

SaaS tracing, evaluation and monitoring for LLM applications.

Provider
default
Kind
Monitoring
Category
Operations
Official docs
https://docs.langchain.com/langsmith/administration-overview
Properties · 5 set by this component
propertytypevaluesrequiredkind defaultthis component
alertGroupingboolean—nofalseinherited
collectorModeenumpull | pushnopull▸ push
evaluations · component propertyboolean—nofalseinherited
independentOfMonitoredboolean—nofalse▸ true
managedboolean—nofalse▸ true
promptHub · component propertyboolean—nofalseinherited
retentionDaysinteger—no—▸ 14
retentionTier · component propertyenumbase | extendednobaseinherited
selfHosted · component propertyboolean—nofalseinherited
signalenummetrics | logs | traces | alerts | allnometrics▸ traces
Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.
Use it in a design
nodes:
  - { id: "langsmith", component: "langsmith" }
Other Monitoring products · 174
ActionTrailalibaba-actiontrailalibabacloudmonitoringApplication Real-Time Monitoring Servicealibaba-armsalibabacloudmonitoringCloudMonitoralibaba-cloud-monitoralibabacloudmonitoringDatabase Autonomy Servicealibaba-dasalibabacloudmonitoringSimple Log Servicealibaba-log-servicealibabacloudmonitoringSecurity Centeralibaba-security-centeralibabacloudmonitoringAmazon CloudWatch investigationsaws-aiopsawsmonitoringAWS Audit Manageraws-audit-managerawsmonitoringAWS CloudTrailaws-cloudtrailawsmonitoringAWS CloudTrail Lakeaws-cloudtrail-lakeawsmonitoringAmazon CloudWatch Application Insightsaws-cloudwatch-application-insightsawsmonitoringAmazon CloudWatch Application Signalsaws-cloudwatch-application-signalsawsmonitoringAmazon CloudWatch Internet Monitoraws-cloudwatch-internet-monitorawsmonitoringAmazon CloudWatch Logsaws-cloudwatch-logsawsmonitoringAmazon CloudWatch Network Flow Monitoraws-cloudwatch-network-flow-monitorawsmonitoringAmazon CloudWatch Network Monitoraws-cloudwatch-network-monitorawsmonitoringAmazon CloudWatch RUMaws-cloudwatch-rumawsmonitoringAmazon CloudWatch Syntheticsaws-cloudwatch-syntheticsawsmonitoringAmazon CodeGuru Profileraws-codeguru-profilerawsmonitoringAWS Compute Optimizeraws-compute-optimizerawsmonitoringAmazon Detectiveaws-detectiveawsmonitoringAmazon DevOps Guruaws-devops-guruawsmonitoringAmazon GuardDutyaws-guarddutyawsmonitoringAmazon Inspectoraws-inspectorawsmonitoringAWS IoT Device Defenderaws-iot-device-defenderawsmonitoringAmazon Macieaws-macieawsmonitoringAmazon Managed Grafanaaws-managed-grafanaawsmonitoringAmazon Managed Service for Prometheusaws-managed-prometheusawsmonitoringAWS Migration Hubaws-migration-hubawsmonitoringAWS Resilience Hubaws-resilience-hubawsmonitoringAWS Security Hub CSPMaws-security-hubawsmonitoringAWS Security Incident Responseaws-security-incident-responseawsmonitoringAWS Trusted Advisoraws-trusted-advisorawsmonitoringAWS X-Rayaws-xrayawsmonitoringAmazon CloudWatchcloudwatchawsmonitoringAzure Advisorazure-advisorazuremonitoringApplication Insightsazure-application-insightsazuremonitoringMicrosoft Defender External Attack Surface Managementazure-defender-easmazuremonitoringMicrosoft Defender for Cloudazure-defender-for-cloudazuremonitoringMicrosoft Defender for IoTazure-defender-for-iotazuremonitoring
and 134 more → Monitoring page
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# LangSmith: SaaS observability and evaluation platform for LLM applications; the SDK pushes traces of
# runs, feedback and evaluation results to smith.langchain.com. Per "Administration overview", traces are
# kept 14 days on the base retention tier and 180 days on the extended tier, after which they are no longer
# readable in the UI or the API; a self-hosted deployment is offered for enterprise plans.
schemaVersion: "1"
type: "component"
id: "langsmith"
kind: "monitoring"
provider: "default"
docs: "https://docs.langchain.com/langsmith/administration-overview"
defaults:
  managed: true
  signal: "traces"
  collectorMode: "push"
  independentOfMonitored: true
  retentionDays: 14
properties:
  retentionTier:
    type: "enum"
    values: ["base", "extended"]
    default: "base"
  selfHosted:
    type: "boolean"
    default: false
  evaluations:
    type: "boolean"
    default: false
  promptHub:
    type: "boolean"
    default: false

The same page as markdown, for an agent: /catalogue/components/langsmith.md