LLM and agent evaluation tools

Updated 31 October 20261 price checked 29 October 2026Reviewed by The Agents Index editorial team

This spot is open
- Top of your category
- First in the home page list
- First on your rivals' pages
- First in search results
- In comparisons and guides
- In the weekly newsletter
- Visits and AI reads each month
Get featured
Promptfoo
Open-source LLM evaluation and red-team testing that can run locally or self-hosted.
Free
Price
Free
- API access: Not stated
- Free tier: Yes
- MCP server: Not stated
- Own API key: Yes
- Open source: Yes
- Self-hosted: Yes
Checked 29 October 2026
Visit PromptfooCompare Promptfoo
Know when LLM and agent evaluation tools change their prices
Agents we’ve just listed and every plan whose price changed.
Email address

Test sets, scorers and judges that measure whether a model or an agent got it right.

LLM and agent evaluation tools compared

AgentVendor's priceMCP serverAPIOpen sourceSelf-host

Promptfoo?MCP ?API +OPEN +SELF

Free

theagentsindex.com · All 1 LLM and agent evaluation tools we list.

Questions buyers ask

Promptfoo has a free plan.

On 29 October 2026, each read on the maker's own pricing page.

Listed A to Z. How we check

Every price here was read on the maker's own pricing page.