Content Safety

azureAI serviceazure-ai-content-safety

Detects harmful text and images and screens prompts for jailbreaks, ungrounded answers and protected material.

Provider
azure
Category
Compute
Properties · 7 set by this component
propertytypevaluesrequiredkind defaultthis component
authenumapi-key | oauth | iam | noneno—▸ api-key
blocklists · component propertyboolean—nofalseinherited
contentFilteringboolean—no—▸ true
customCategories · component propertyboolean—nofalseinherited
customerManagedKeysboolean—no—▸ false
dataResidency · advancedenumus | eu | asia | globalno—inherited
dataRetentionDaysinteger—no—inherited
keyStoreboolean—nofalseinherited
managedboolean—nofalse▸ true
maxImageSizeMb · component propertyinteger—no4inherited
maxTextLength · component propertyinteger—no10000inherited
modalityenumtext | vision | speech | multimodal | structured | image | video | audio | embedding | rerankno—▸ multimodal
promptShields · component propertyboolean—nofalseinherited
publicEndpointboolean—no—▸ true
quotaUnitsPerMinuteinteger—no—▸ 6000
rateLimitRpm · advancedinteger—no—inherited
rateLimitTpm · advancedinteger—no—inherited
tier · component propertyenumf0 | s0no—inherited
viaGatewayboolean—nofalseinherited
Rules that apply · 2

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

ai-api-key-unmanaged

This AI vendor is reached with an API key, and nothing in the design holds or rotates that key. It ends up in environment files or code, every caller shares it, and a single leak runs up the vendor bill until someone notices. Put the key in a key-management component, or say it is held there with keyStore.

  • — all of these hold:
  • — the node's `auth` is "api-key"
  • — the node's `keyStore` is false
  • — the node has at least one incoming edge from an app-server, worker or client
  • — this does not hold:
  • — the design contains a node of kind key-management
stateful-node-without-zone-redundancy

A stateful compute node pinned to exactly one availability zone disappears with that zone, and its state goes with it. Nodes inside a cell are exempt, because there the cell is deliberately single-zone and redundancy comes from the other cells.

  • — all of these hold:
  • — the node's `stateless` is false
  • — the node sits inside exactly 1 availability-zone group
  • — this does not hold:
  • — the node sits inside at least one cell group
Use it in a design
nodes:
  - { id: "ai-content-safety", component: "azure-ai-content-safety" }
Other AI service products · 125
Content Moderationalibaba-content-moderationalibabacloudai-serviceFraud Detectionalibaba-fraud-detectionalibabacloudai-serviceID Verificationalibaba-id-verificationalibabacloudai-serviceIntelligent Robotalibaba-intelligent-robotalibabacloudai-serviceModel Studioalibaba-model-studioalibabacloudai-serviceSmart Conversation Analysisalibaba-smart-conversation-analysisalibabacloudai-serviceAmazon Bedrockaws-bedrockawsai-serviceAmazon Bedrock AgentCoreaws-bedrock-agentcoreawsai-serviceAmazon Bedrock Data Automationaws-bedrock-data-automationawsai-serviceAmazon Bedrock Guardrailsaws-bedrock-guardrailsawsai-serviceAmazon Comprehendaws-comprehendawsai-serviceAmazon Comprehend Medicalaws-comprehend-medicalawsai-serviceAWS Elemental Inferenceaws-elemental-inferenceawsai-serviceAmazon Forecastaws-forecastawsai-serviceAmazon Fraud Detectoraws-fraud-detectorawsai-serviceAWS HealthScribeaws-healthscribeawsai-serviceAmazon Lex botaws-lexawsai-serviceAmazon Lookout for Equipmentaws-lookout-for-equipmentawsai-serviceAmazon Lookout for Metricsaws-lookout-for-metricsawsai-serviceAmazon Lookout for Visionaws-lookout-for-visionawsai-serviceAmazon Personalizeaws-personalizeawsai-serviceAmazon Pollyaws-pollyawsai-serviceAmazon Q Businessaws-q-businessawsai-serviceAmazon Rekognitionaws-rekognitionawsai-serviceAmazon Textractaws-textractawsai-serviceAmazon Transcribeaws-transcribeawsai-serviceAmazon Translateaws-translateawsai-serviceAzure AI Custom Visionazure-ai-custom-visionazureai-serviceAzure AI Faceazure-ai-faceazureai-serviceAzure Languageazure-ai-languageazureai-serviceAzure Speechazure-ai-speechazureai-serviceAzure Translatorazure-ai-translatorazureai-serviceAzure Visionazure-ai-visionazureai-serviceAzure Content Understandingazure-content-understandingazureai-serviceMicrosoft Discoveryazure-discoveryazureai-serviceAzure Document Intelligenceazure-document-intelligenceazureai-serviceFoundry Agent Serviceazure-foundry-agent-serviceazureai-serviceFoundry Modelsazure-foundry-modelsazureai-serviceAzure AI Immersive Readerazure-immersive-readerazureai-serviceAzure OpenAI in Foundry Modelsazure-openaiazureai-service
and 85 more → AI service page
Source
# yaml-language-server: $schema=../../schema/component.schema.json
# Azure AI Content Safety: text and image harm detection plus prompt shields, groundedness and protected material detection.
# "What is Azure AI Content Safety?" gives the S0 rate limits (1,000 requests per 10 seconds for the moderation APIs, so 6,000 per minute) and the input limits of 10,000 characters for analyze text and 4 MB for analyze image; managed identity is enabled automatically on resource creation.
# Prompt Shields ("Prompt Shields in Azure AI Content Safety") is its own text:shieldPrompt call that screens user prompts and documents for injection attacks, so promptShields starts off.
schemaVersion: "1"
type: "component"
id: "azure-ai-content-safety"
kind: "ai-service"
provider: "azure"
docs: "https://learn.microsoft.com/en-us/azure/ai-services/content-safety/overview"
defaults:
  auth: "api-key"
  managed: true
  modality: "multimodal"
  contentFiltering: true
  publicEndpoint: true
  customerManagedKeys: false
  quotaUnitsPerMinute: 6000
properties:
  tier:
    type: "enum"
    values: ["f0", "s0"]
  maxTextLength:
    type: "integer"
    default: 10000
  maxImageSizeMb:
    type: "integer"
    default: 4
  blocklists:
    type: "boolean"
    default: false
  customCategories:
    type: "boolean"
    default: false
  promptShields:
    type: "boolean"
    default: false

The same page as markdown, for an agent: /catalogue/components/azure-ai-content-safety.md