Promptfoo

Promptfoo is a security platform that helps developers and enterprises build secure AI applications. It integrates into development workflows to simulate real users, perform automated red teaming, and identify vulnerabilities across prompts, models, and integrations. The tool targets teams building AI-enabled software, from individual developers to large organizations, and emphasizes scalable security testing within existing processes.

Promptfoo operates by connecting to AI apps, agents, and workflows, enabling thousands of context-aware attacks and continuous testing from CI/CD to production. It leverages real-time threat intelligence from a large community, and provides remediation guidance directly in pull requests and developer workflows. The process covers integration, attack generation, and remediation in a cohesive cycle.

The platform offers capabilities for red teaming, evaluations, code scanning, model security, guardrails, and managed test types (MCP). It presents vulnerability coverage across multiple domains, real-time threat intel, and scalable automation. It emphasizes enterprise-grade deployment options, ongoing monitoring, and collaboration features to support security at scale.

Promptfoo lists plans including Community (free/open-source) and Enterprise and On-Premise options. It mentions integrations with CI/CD pipelines, various providers, and self-hosted deployments. It notes data residency and privacy considerations through self-hosted options and continuous monitoring capabilities, as well as API access and collaboration features.

Use cases

• Security testing for AI development lifecycles, including red teaming, model security, and guardrails.