# Promptfoo — Open-source LLM evaluation and red-team testing that can run locally or self-hosted. > Source: The Agents Index — https://theagentsindex.com/promptfoo (structured, researched, re-verified) Promptfoo is an open-source CLI and library for evaluating and red-teaming LLM applications. It benchmarks prompts, models, and RAGs, then reports vulnerabilities and automated scores across local, cloud, and self-hosted deployments. **Best for:** Developers and enterprise teams testing and securing LLM applications | Fact | Value | | --- | --- | | Website | https://promptfoo.dev/ | | Category | LLM & agent evaluation | | Open source | Yes | | Price | Free | | Price source | https://www.promptfoo.dev/pricing | | Price checked | 29 October 2026 | | MCP server | Not stated | | API | Not stated | | Self-host | Yes | | Facts | 16 facts from 8 sources | | Facts checked | 29 October 2026 | Screenshot of Promptfoo: https://theagentsindex.com/img/1920/screenshots/promptfoo.webp, captured 31 October 2026 **What we checked** - Pages last read: 29 October 2026 - Facts checked: 16 facts (From 8 sources) - AI answers: Named in 0 of 151 (Our October check) ## What we checked on Promptfoo ### Which models it runs on **Open models** · Yes — Promptfoo supports open-weight models through providers and specifically identifies Llama among supported model options. > Use OpenAI, Anthropic, Azure, Google, HuggingFace, open-source models like Llama > — https://www.promptfoo.dev/docs/intro/ · Intro, With promptfoo you can list, checked 29 October 2026 **Model choice** · Yes — Users configure providers in Promptfoo, including custom API providers, rather than accepting a single vendor-selected model. > Use OpenAI, Anthropic, Azure, Google, HuggingFace, open-source models like Llama, or integrate custom API providers for any LLM API > — https://www.promptfoo.dev/docs/intro/ · Intro, With promptfoo you can list, checked 29 October 2026 ### Whose machine it runs on **Self-hosted** · Yes — Promptfoo supplies a Docker-based self-hosted server for storing evaluations and sharing results on buyer-controlled infrastructure. > Promptfoo provides a basic Docker image that allows you to host a server that stores evals. > — https://www.promptfoo.dev/docs/usage/self-hosting/ · Self-hosting Promptfoo opening paragraph, checked 29 October 2026 **Open source** · Yes — The vendor explicitly calls Promptfoo an open-source CLI and library for evaluating and red-teaming LLM applications. > `promptfoo` is an open-source CLI and library for evaluating and red-teaming LLM apps. > — https://www.promptfoo.dev/docs/intro/ · Intro opening paragraph, checked 29 October 2026 **Licence** · Yes — Open source — Promptfoo describes its CLI and library as an open-source project without vendor-account runtime dependence. > `promptfoo` is an open-source CLI and library for evaluating and red-teaming LLM apps. > — https://www.promptfoo.dev/docs/intro/ · Intro opening paragraph, checked 29 October 2026 **Open-source runtime** · Yes — The open-source software runs completely locally, with evaluations executing on the user's own machine and direct model calls. > This software runs completely locally. The evals run on your machine and talk directly with the LLM. > — https://www.promptfoo.dev/docs/intro/ · Why choose promptfoo, Private bullet, checked 29 October 2026 ### Building with it **SDK languages** · Yes — TypeScript and JavaScript are documented SDK surfaces through the Node package and its evaluate function. > Integrate LLM testing into Node.js apps with promptfoo's evaluate() function. Configure providers, run test suites, and analyze results using TypeScript/JavaScript APIs. > — https://www.promptfoo.dev/docs/usage/node-package/ · Node package page meta description, checked 29 October 2026 **Tracing and evals** · Yes — Promptfoo evaluates outputs with automatic scoring, and its Node evaluation context includes optional trace data for debugging. > context: execution context, including `prompt`, `vars`, `test`, `logProbs`, `config`, `provider`, `providerResponse`, and optional `trace` data for debugging > — https://www.promptfoo.dev/docs/usage/node-package/ · Assertion functions, AssertionValueFunctionContext description, checked 29 October 2026 ### What it costs to run **How it meters** · Yes — Community is free forever with a monthly probe allowance, while Enterprise pricing is customized by team size and needs. > Enterprise pricing is customized based on your team's size and needs. Contact us for a personalized quote. > — https://www.promptfoo.dev/pricing · Frequently Asked Questions, How does Enterprise pricing work?, checked 29 October 2026 **Free tier** · Yes — The Community plan is presented as a permanent free option for individual developers and small teams. > Free Forever Our open-source tool, perfect for individual developers and small teams. > — https://www.promptfoo.dev/pricing · Community plan card, checked 29 October 2026 **Bring your own key** · Yes — Local CLI and library executions send LLM API requests directly to the configured model provider. > any call to Language Model (LLM) APIs (OpenAI, Anthropic, etc.) are sent directly to the LLM provider. > — https://www.promptfoo.dev/privacy/ · Information You Provide to Us, local CLI and library paragraph, checked 29 October 2026 ### Buying it for a team **A company can buy it** · Yes — Promptfoo sells a customized Enterprise offering for larger teams and organizations that continuously monitor application risk. > Larger teams and organizations that want to continuously monitor risk in development and production. > — https://www.promptfoo.dev/pricing · Frequently Asked Questions, Who needs the Enterprise version?, checked 29 October 2026 **Admin controls** · Partly — Enterprise provides custom roles and scoped permissions, while the Community edition lacks RBAC controls. > Promptfoo Enterprise supports a flexible role-based access control (RBAC) system that allows you to manage user access to your organization's resources. > — https://www.promptfoo.dev/docs/enterprise/teams/ · Managing Roles and Teams introduction, checked 29 October 2026 **Single sign-on** · Partly — SAML 2.0 and OIDC SSO are available in Promptfoo Enterprise, not documented for the Community product. > Promptfoo Enterprise supports both basic authentication and SSO through SAML 2.0 and OIDC. > — https://www.promptfoo.dev/docs/enterprise/authentication/ · Setting Up SSO, checked 29 October 2026 ### What happens to your code **Data residency** · Yes — Promptfoo says it is headquartered in the United States and personal information may transfer there or elsewhere. > Your personal information may be transferred to the United States or other locations where privacy laws may not be as protective as those in your state, province, or country. > — https://www.promptfoo.dev/privacy/ · International Data Transfer, checked 29 October 2026 **Getting out** · Yes — Enterprise documentation lists sharing and exporting functions, although it does not state an expiry policy for free probes. > Sharing and exporting functions to integrate Promptfoo with your existing tools > — https://www.promptfoo.dev/docs/enterprise/ · Promptfoo Enterprise feature list, checked 29 October 2026 ## Promptfoo price and terms **Terms** - Free plan: Yes — Community is Free Forever and includes red teaming (10k probes/month) **What needs a higher plan** - Enterprise: A company can buy it - Promptfoo Enterprise: Admin controls, Single sign-on, Getting out Pricing page as we captured it: https://theagentsindex.com/img/1920/screenshots/promptfoo/pricing.webp, captured 31 October 2026 Read on https://www.promptfoo.dev/pricing, 29 October 2026. ## Questions about Promptfoo ### How much does Promptfoo cost? Promptfoo is free to use. From promptfoo.dev/pricing, checked 29 October 2026. ### Is Promptfoo open source, and can you host it yourself? It is open source. You can host it yourself. ### What have we checked on Promptfoo? 16 facts, under these headings: Which models it runs on, whose machine it runs on, building with it, what it costs to run, buying it for a team, what happens to your code. ### How do we check Promptfoo? We hold 16 facts on Promptfoo, quoted from 8 pages. Facts and price last checked 29 October 2026. How we check every listing: https://theagentsindex.com/methodology/ ## Sources and changes Last changed 31 October 2026 **Sources on promptfoo.dev** (8) - https://www.promptfoo.dev/docs/intro/, read 29 October 2026 - https://www.promptfoo.dev/pricing, read 29 October 2026 - https://www.promptfoo.dev/docs/usage/node-package/, read 29 October 2026 - https://www.promptfoo.dev/privacy/, read 29 October 2026 - https://www.promptfoo.dev/docs/enterprise/, read 29 October 2026 - https://www.promptfoo.dev/docs/enterprise/authentication/, read 29 October 2026 - https://www.promptfoo.dev/docs/enterprise/teams/, read 29 October 2026 - https://www.promptfoo.dev/docs/usage/self-hosting/, read 29 October 2026 ## Is this yours? AI assistants like ChatGPT and Claude opened The Agents Index pages 2,746 times in September. Claim Promptfoo: https://theagentsindex.com/claim/promptfoo Report an error if a fact is wrong: hello@theagentsindex.com, subject "Report an error: Promptfoo (promptfoo)".