promptfoo

Open-source CLI for LLM evals and red teaming, run locally or in CI.

Provider: default
Kind: CI/CD pipeline
Category: Operations
Official docs: https://www.promptfoo.dev/docs/integrations/ci-cd/

Properties · 2 set by this component

property	type	values	required	kind default	this component
approvalRequired	boolean	—	no	—	inherited
artifactSigning	boolean	—	no	—	inherited
concurrency	integer	—	no	—	inherited
managed	boolean	—	no	false	▸ false
qualityGate · component property	boolean	—	no	—	inherited
redTeam · component property	boolean	—	no	false	inherited
secretsFromVault	boolean	—	no	—	inherited
selfHostedRunners	boolean	—	no	—	inherited
trigger	enum	manual \| commit \| pull-request \| schedule	no	—	▸ pull-request

Rules that apply · 0

Every rule whose selector covers this component's kind or its category. Whether a rule fires depends on the design: its properties, its edges and its groups.

No rule reads this kind yet. That is a gap, not a guarantee.

Use it in a design

nodes:
  - { id: "promptfoo", component: "promptfoo" }

Other CI/CD pipeline products · 56

Alibaba Cloud DevOps Flowalibaba-devops-flowalibabacloudci-pipeline AWS CodeBuildaws-codebuildawsci-pipeline Amazon CodeCatalystaws-codecatalystawsci-pipeline AWS CodeDeployaws-codedeployawsci-pipeline AWS CodePipelineaws-codepipelineawsci-pipeline EC2 Image Builderaws-ec2-image-builderawsci-pipeline AWS Protonaws-protonawsci-pipeline AWS Telco Network Builder (TNB)aws-tnbawsci-pipeline Azure Deployment Environmentsazure-deployment-environmentsazureci-pipeline Managed DevOps Poolsazure-managed-devops-poolsazureci-pipeline Azure Operator Service Managerazure-operator-service-managerazureci-pipeline Azure Pipelinesazure-pipelinesazureci-pipeline Azure VM Image Builderazure-vm-image-builderazureci-pipeline Argo CDargo-cdci-pipeline Atlantisatlantisci-pipeline Automation pipelineautomation-pipelineci-pipeline Ansible AWXawxci-pipeline Atlassian Bamboobambooci-pipeline Buildkitebuildkiteci-pipeline Chef Infrachefci-pipeline Generic CI/CD pipelineci-pipelineci-pipeline CircleCIcirclecici-pipeline Concourseconcourseci-pipeline Crossplanecrossplaneci-pipeline DeepEvaldeepevalci-pipeline Dronedroneci-pipeline Fluxfluxci-pipeline GitHub Actionsgithub-actionsci-pipeline GitLab CI/CDgitlab-cici-pipeline HCP Terraformhcp-terraformci-pipeline Jenkinsjenkinsci-pipeline PipeCDpipecdci-pipeline Puppet Enterprisepuppetci-pipeline Salt Projectsaltci-pipeline Spinnakerspinnakerci-pipeline JetBrains TeamCityteamcityci-pipeline Tektontektonci-pipeline Travis CItravis-cici-pipeline Woodpecker CIwoodpeckerci-pipeline Zuulzuul-cici-pipeline

and 16 more → CI/CD pipeline page

Source

1# yaml-language-server: $schema=../../schema/component.schema.json
2# promptfoo: open-source CLI for LLM evals and red teaming that runs locally or in CI. Per "CI/CD Integration
3# for LLM Eval and Security", the GitHub Actions example runs `npx promptfoo@latest eval` on pull requests
4# touching prompts, while security scans use a daily schedule. Acquired by OpenAI (announced March 2026).
5schemaVersion: "1"
6type: "component"
7id: "promptfoo"
8kind: "ci-pipeline"
9provider: "default"
10docs: "https://www.promptfoo.dev/docs/integrations/ci-cd/"
11defaults:
12  managed: false
13  trigger: "pull-request"
14properties:
15  redTeam:
16    type: "boolean"
17    default: false
18  qualityGate:
19    type: "boolean"

The same page as markdown, for an agent: /catalogue/components/promptfoo.md