What we checked on Promptfoo
Open models
Promptfoo supports open-weight models through providers and specifically identifies Llama among supported model options.
Use OpenAI, Anthropic, Azure, Google, HuggingFace, open-source models like Llama
promptfoo.dev/docs/introChecked
Model choice
Users configure providers in Promptfoo, including custom API providers, rather than accepting a single vendor-selected model.
Use OpenAI, Anthropic, Azure, Google, HuggingFace, open-source models like Llama, or integrate custom API providers for any LLM API
promptfoo.dev/docs/introChecked
Self-hosted
Promptfoo supplies a Docker-based self-hosted server for storing evaluations and sharing results on buyer-controlled infrastructure.
Promptfoo provides a basic Docker image that allows you to host a server that stores evals.
Open source
The vendor explicitly calls Promptfoo an open-source CLI and library for evaluating and red-teaming LLM applications.
promptfoo is an open-source CLI and library for evaluating and red-teaming LLM apps.
promptfoo.dev/docs/introChecked
Licence
Open source — Promptfoo describes its CLI and library as an open-source project without vendor-account runtime dependence.
On the page: Intro opening paragraph
promptfoo.dev/docs/introChecked
Open-source runtime
The open-source software runs completely locally, with evaluations executing on the user's own machine and direct model calls.
This software runs completely locally. The evals run on your machine and talk directly with the LLM.
promptfoo.dev/docs/introChecked
SDK languages
TypeScript and JavaScript are documented SDK surfaces through the Node package and its evaluate function.
Integrate LLM testing into Node.js apps with promptfoo's evaluate() function. Configure providers, run test suites, and analyze results using…
Tracing and evals
Promptfoo evaluates outputs with automatic scoring, and its Node evaluation context includes optional trace data for debugging.
context: execution context, including prompt, vars, test, logProbs, config, provider, providerResponse, and optional trace data for debugging
How it meters
Community is free forever with a monthly probe allowance, while Enterprise pricing is customized by team size and needs.
Enterprise pricing is customized based on your team's size and needs. Contact us for a personalized quote.
promptfoo.dev/pricingChecked
Free tier
The Community plan is presented as a permanent free option for individual developers and small teams.
Free Forever Our open-source tool, perfect for individual developers and small teams.
promptfoo.dev/pricingChecked
Bring your own key
Local CLI and library executions send LLM API requests directly to the configured model provider.
any call to Language Model (LLM) APIs (OpenAI, Anthropic, etc.) are sent directly to the LLM provider.
promptfoo.dev/privacyChecked
A company can buy it
Promptfoo sells a customized Enterprise offering for larger teams and organizations that continuously monitor application risk.
Larger teams and organizations that want to continuously monitor risk in development and production.
promptfoo.dev/pricingChecked
Admin controls
Enterprise provides custom roles and scoped permissions, while the Community edition lacks RBAC controls.
Promptfoo Enterprise supports a flexible role-based access control (RBAC) system that allows you to manage user access to your organization's…
Single sign-on
SAML 2.0 and OIDC SSO are available in Promptfoo Enterprise, not documented for the Community product.
Promptfoo Enterprise supports both basic authentication and SSO through SAML 2.0 and OIDC.
Data residency
Promptfoo says it is headquartered in the United States and personal information may transfer there or elsewhere.
Your personal information may be transferred to the United States or other locations where privacy laws may not be as protective as those in your…
promptfoo.dev/privacyChecked
Getting out
Enterprise documentation lists sharing and exporting functions, although it does not state an expiry policy for free probes.
Sharing and exporting functions to integrate Promptfoo with your existing tools
Promptfoo price and terms
Terms
- Free plan
- YesYesCommunity is Free Forever and includes red teaming (10k probes/month)
What needs a higher plan
- Enterprise
- A company can buy it
- Promptfoo Enterprise
- Admin controls, Single sign-on, Getting out
Pricing page, captured
promptfoo.dev/pricing, checked
Questions about Promptfoo
- How much does Promptfoo cost?
- Promptfoo is free to use. From promptfoo.dev/pricing, checked 29 October 2026.
- Is Promptfoo open source, and can you host it yourself?
- It is open source. You can host it yourself.
- What have we checked on Promptfoo?
- 16 facts, under these headings: Which models it runs on, whose machine it runs on, building with it, what it costs to run, buying it for a team, what happens to your code.
- How do we check Promptfoo?
- We hold 16 facts on Promptfoo, quoted from 8 pages. Facts and price last checked 29 October 2026.
Sources and changes
Last changed
Is this yours?
AI assistants like ChatGPT and Claude opened The Agents Index pages 2,746 times in September. Claiming is free. You get this page's reader numbers and the verified owner mark. You confirm it with an email at promptfoo.dev.
Report an error if a fact is wrong.