Promptfoo
Open-source CLI and platform for red teaming, scanning and evaluating LLM apps and agents.
What it is
Promptfoo is an MIT-licensed command-line tool and library for testing LLM applications. It evaluates prompts, agents and RAG setups, compares models across providers, runs red team probes for vulnerabilities and fits into CI/CD pipelines. The commercial platform adds guardrails, model security, an MCP proxy, code scanning, team collaboration, SSO and managed cloud or on-premise deployment.
Heads up: Promptfoo announced in March 2026 that it agreed to be acquired by OpenAI, and the open-source project continues.
MCP server
We have not checked yet whether Promptfoo offers an MCP server for AI agents.
Promptfoo alternatives
Cursor
by Anysphere
AI code editor with coding agents, built by Anysphere.
GitHub Copilot
by GitHub (Microsoft)
AI coding assistant in the IDE, CLI and GitHub, with agent mode and code review.
AI app builder that turns prompts into working web apps and internal tools.
Replit
by Replit, Inc.
Browser-based environment where Replit Agent builds and deploys apps from prompts.
v0
by Vercel
Vercel's AI assistant for building web apps and UIs from text prompts.
Bolt
by StackBlitz
AI builder that creates websites and apps from plain-language prompts.