Skip to content

The datasheet for every AI agent

Research report · data-report

Writes tests: a census of 126 listings

19 of 126 listings answer yes for “Writes tests”. Counted from our own datasheet, with the query that reproduces every figure.

Sep 12, 2026updated Sep 16, 20262 min readSource-linked research

Writes tests, across 126 settled listings

  1. Yes19 of 126

  2. Qualified30 of 126

  3. No9 of 126

  4. Does not apply59 of 126

  5. Not established9 of 126

Of the 126 Published listings whose datasheet settles “Writes tests”, the largest group is “Does not apply” at 59 (47%). Measured 2026-09-16.

Denominator: 126 Published listings whose datasheet settles “Writes tests”.Method: Counted from the stored datasheet answer for “Writes tests” across every Published listing, all of which have a recognised stored answer on that row.Measured .
Cite this chart

Reuse this chart anywhere, with credit. Paste this HTML — it links back to the report the numbers come from.

<a href="https://theagentsindex.com/blog/writes-tests-census/" target="_blank" rel="nofollow noopener"><img src="https://theagentsindex.com/charts/writes-tests-census.png" alt="Writes tests, across 126 settled listings — The Agents Index" title="Writes tests, across 126 settled listings — The Agents Index" width="640" loading="lazy" style="max-width:100%;height:auto" /></a>

Explore the matching agents

Writes tests · Datasheet criterion writes_tests · Report counted .

Current listings as of ; this set may differ from the report's original sample. Includes “Yes” and “Qualified” answers only. Read the conditions on qualified answers before treating them as a match. “No”, “Not applicable” and “Not established” answers are excluded.

View 49 current matching records
  • Agentix Labs Qualified

    Tests here mean workflow acceptance and evaluation cases for the agent, not unit tests written into a client's repository.

    Source retrieved 2026-09-09

  • AgentsKit.js Qualified

    Test writing is a prompt-level behaviour of the coder persona pinned to Vitest conventions, not a separate test-generation tool or package on the sheet.

    Source retrieved 2026-09-09

  • Agno Qualified

    The documented Verify stage runs the repository's existing gates; test authoring appears only in the example prompt, not as a capability claim.

  • Aider Yes

    The vendor publishes a worked transcript of aider authoring a black-box unit test from the repository map alone, without the source of the function under test in context.

    Source retrieved 2026-09-09

  • Aisera Agent Studio Qualified

    It generates test cases, but conversational ones: the documented Test Suite turns historical requests and knowledge-base articles into replayable cases that check agent behaviour, not unit tests for source code.

    Source retrieved 2026-09-03

  • Antigravity CLI Yes

    The vendor's own best-practice sequence is to have the agent author a test block before implementing, then run the suite to verify its change.

    Source retrieved 2026-09-10

  • Augment Code Yes

    Agent generates unit tests for new code; the legacy-migration workflow adds tests as part of each module PR.

    Source retrieved 2026-09-02

  • Bitsclan IT Solutions Qualified

    Testing is described as a quality-assurance stage their team performs before launch; nothing says a test suite is written for or handed over to the client to run afterwards.

    Source retrieved 2026-09-11

  • Bland Qualified

    It generates and runs call-scenario suites with assertions against the agent, including scenarios derived from historical transcripts; these are conversation tests, not unit tests for code.

  • Botpress Qualified

    Tests are evals: automated conversation tests of agent behaviour, run by the adk CLI. The adk-evals skill writes them, and there are no unit tests over source code.

    Source retrieved 2026-09-02

  • Claude Agent SDK Yes

    The agent-loop walkthrough has the agent updating and re-running a project's tests alongside its edits.

    Source retrieved 2026-09-02

  • Claude Code Yes

    Writes tests for untested code as a named use case, and runs them as part of the same task.

    Source retrieved 2026-09-02

  • Cline Yes

    Test authoring is a named use case, covering unit and integration tests for existing large codebases rather than only tests for code it just wrote.

    Source retrieved 2026-09-12

  • CodeRabbit Qualified

    Unit test generation is a Team-and-above finishing touch, absent from the entry Essentials plan, and is itself labelled open beta on GitHub, GitLab and Azure DevOps.

    Source retrieved 2026-09-15

  • Codex CLI Yes

    Documented CLI workflow for writing a unit test for a named function.

    Source retrieved 2026-09-02

  • Crescendo Qualified

    It generates and runs happy-path and failure-path scenarios against each integration before the assistant may call it; these are vendor-run integration checks, not a test suite you own or edit.

    Source retrieved 2026-09-12

  • Cresta Qualified

    Cresta generates test cases and LLM evaluators for agent behaviour from production traffic and documentation; these are conversation tests, not software unit tests.

    Source retrieved 2026-09-02

  • Cursor Yes

    Test generation is named as agent work, and Automations can be configured to add tests on every new commit.

    Source retrieved 2026-09-02

  • Devin Yes

    Analyses the repository's existing test style and writes additional tests to raise coverage.

    Source retrieved 2026-09-02

  • Devin Desktop Qualified

    The only test-writing claim describes cloud Devin sessions delegated from a Space; no equivalent statement is made for the local agents.

    Source retrieved 2026-09-03

  • Factory Yes

    The /install-qa skill generates QA sub-skills and executes end-to-end test flows per diff, with evidence.

    Source retrieved 2026-09-02

  • Gemini Code Assist Yes

    Test generation is one of the prebuilt smart actions in the IDE, and the overview lists unit-test generation as a chat capability.

    Source retrieved 2026-09-02

  • Genspark Qualified

    Testing is named as a step the agent performs on what it builds; nothing on the site says it authors a test suite or runs your project's existing tests.

    Source retrieved 2026-09-15

  • GitHub Copilot Yes

    Test work is a named cloud-agent task, and the agent runs the tests it writes in its own ephemeral environment.

    Source retrieved 2026-09-02

  • Glean Qualified

    Test changes appear in the vendor's own agent example output; no dedicated test-generation feature is documented.

  • Google Agent Development Kit (ADK) Qualified

    What it generates are agent evaluation sets captured from real sessions, not unit tests; the evaluation tooling is documented as Python-only, so other language bindings do not get it.

    Source retrieved 2026-09-15

  • goose Qualified

    Test generation is not native: goose produces Playwright specs only after you install the third-party Playwright CLI agent skill plus Node and the Summon extension, and the docs show it writing browser tests rather than unit tests.

    Source retrieved 2026-09-16

  • Junie Yes

    Runs code and tests as part of a task and verifies the result; plan mode produces an explicit test strategy and test cases.

    Source retrieved 2026-09-02

  • Kilo Code Yes

    Test writing is named as part of the SDLC coverage Kilo sells to enterprises.

    Source retrieved 2026-09-02

  • LangChain Qualified

    Engine generates evals and datasets rather than unit tests, and the row is checked only for Plus and Enterprise.

    Source retrieved 2026-09-02

  • Letta Qualified

    Vendor claims agents run test suites; it never claims they author tests.

  • Lindy Qualified

    QA agents exercise the app in a browser; the vendor never claims it produces test code you keep

  • Manus Qualified

    Claims it tests the app it just generated; no claim that it authors test code or a test suite.

    Source retrieved 2026-09-02

  • MindStudio Qualified

    Evaluations auto-generates and runs structured test cases against an agent workflow with literal or fuzzy expected results; these are agent evaluations, not unit tests for application source code.

    Source retrieved 2026-09-02

  • OpenAI Agents SDK (Python) Qualified

    Adding a regression test is given as a sandbox multi-step workflow example; no dedicated test-generation feature is documented. The SDK's own testing utilities test agent workflows, not application code.

    Source retrieved 2026-09-02

  • OpenHands Yes

    Test generation and coverage expansion is a named workflow; a separate QA agent also exercises the running software rather than the test suite.

    Source retrieved 2026-09-02

  • PolyAI Qualified

    It authors and maintains conversation simulation tests that run in CI; these are agent scenario tests, not unit tests for source code.

    Source retrieved 2026-09-02

  • Replit Agent Qualified

    Replit says Agent tests the app it builds by driving a real browser; it never claims Agent authors test code or a test suite.

    Source retrieved 2026-09-02

  • Retell AI Qualified

    Produces graded conversation test cases for its own agents, not software tests.

  • SafeNet Creations Qualified

    Testing here is pre-launch acceptance testing of agreed workflows and fallback paths, not authored automated test suites handed to the client.

    Source retrieved 2026-09-04

  • Salesforce Agentforce Yes

    Apex test classes and LWC Jest tests are generated alongside the code, with a dedicated QA Validator sub-agent for coverage.

    Source retrieved 2026-09-03

  • Sierra Qualified

    Conversation and voice simulations are generated and run on every agent build, and Agent Studio keeps them as a regression suite; these test agent behaviour, not your code.

    Source retrieved 2026-09-03

  • TecAdRise Qualified

    Builds are exercised with sample data and a staging run before launch, and trading work adds automated walk-forward validation, but no automated unit or regression test suite is promised as a deliverable.

    Source retrieved 2026-09-12

  • UiPath Agent Builder Qualified

    It ships an evaluation harness rather than a test writer: evals score agent outcomes against ground truth before deploy and Optimize proposes changes, but you author the eval sets and none of this produces unit tests for a codebase.

    Source retrieved 2026-09-03

  • Vecbase Yes

    A dedicated unit-test task writes tests against the uploaded code and runs them where the environment allows.

    Source retrieved 2026-09-03

  • Vellum Qualified

    Test authoring is named only as a task delegated to a connected third-party coding agent; there is no test-writing skill of Vellum's own in the skills catalog.

    Source retrieved 2026-09-03

  • Warp Yes

    Test authoring is one of the vendor's enumerated coding capabilities, and the agent can run the test it wrote inside a REPL session.

    Source retrieved 2026-09-03

  • Zencoder Yes

    Writing tests is named as a first-class task type, and after each task Zenflow runs the repository's own linters, type-checkers and test suites as verification.

    Source retrieved 2026-09-09

  • zot Qualified

    Test authoring appears only as an example task for a swarm sub-agent; there is no test-generation feature in the tool set or the docs.

The population

126 listings in this index are Published. This is the population as of 2026-09-16. 126 of the 126 published listings in this index carry a settled answer for “Writes tests”. That row asks: Does it produce tests, not just code? Every listing in the index is settled on this row, so nothing is left out.

Findings

  1. 19 of the 126 settled listings answer “Yes” for “Writes tests”. That is 15% of the settled set.

  2. 30 of the 126 settled listings answer “Qualified” for “Writes tests”. That is 24% of the settled set.

  3. 9 of the 126 settled listings answer “No” for “Writes tests”. That is 7% of the settled set.

  4. 59 of the 126 settled listings answer “Does not apply” for “Writes tests”. That is 47% of the settled set.

  5. 9 of the 126 settled listings answer “Not established” for “Writes tests”. That is 7% of the settled set.

1 of those yes answers is Zencoder, which still answers yes for “Writes tests”. Its listing carries the stored answer and links to the source recorded for it. This is one worked example, not an independent audit of every source in the census.

What we counted, and how

Each figure above is a count over the “Writes tests” row of the listing datasheet, taken from the same stored answer the listing page renders. The denominator is the 126 listings whose answer is settled, meaning one of yes, qualified, no, does not apply, not established. On this row that is the whole index, because every listing has a recognised stored answer. Every number here is stored with the read-only query that reproduces it and re-run every sixty seconds against the live corpus, so a figure that stops reproducing surfaces as drift rather than as a stale sentence nobody notices. Our full method covers how a datasheet row is settled in the first place.

Limitations

This counts stored datasheet answers, not independently tested capabilities. A sourced answer can record a vendor statement or our reading of published evidence; this census does not re-fetch those sources. “Not established” means we have not established an answer. That can reflect vendor nondisclosure, blocked evidence, or unfinished research, not a no. An absent or unrecognised answer is excluded rather than treated as a researched finding. The figures are restated when the stored corpus changes; the date above is the count used for this published version, not a new verification of the vendors.

Get the next report

New agents rankings and fresh data reports. One short email, one-click unsubscribe.