FAQ

Are Loadout rankings based on tests?

Not yet. Every ranking is an initial editorial order, pending agent-run tests. No Loadout Score is shown until a tool runs our versioned task set. What has been published so far are smoke tests, evidence-based reviews of public benchmarks and harness validations, each labeled for what it is (4 logs).

How is the Loadout Score calculated?

Loadout Score (0–100) = Σ(criterion score 0–10 × weight%) × 10, across seven criteria: output quality, speed & reliability, control, value, Agent-Ready, ecosystem and trust. Weights differ per use case and are published on the methodology page.

What is the Agent-Ready score?

A 0–10 count of documented ways an AI agent can drive a tool: public API (3), official MCP server (2), CLI or headless mode (2), SDK (1), machine-friendly docs (1) and agent-friendly auth & limits (1). Points come from a public-docs review, and each one links to its source.

What is the difference between "tested" and "evidence-based evaluation"?

Tested means Loadout ran the tool on its own task set and graded the output. Evidence-based evaluation means we read public third-party benchmarks or documentation. We label it "not tested by Loadout", and it can't produce a score on its own.

How often do ranks change?

Ranks recompute weekly. A tool must beat the incumbent by at least 2 points on a tested score to swap places, which prevents noisy flip-flopping. Every change is listed on the movers page with its reason.

Can a company pay to rank higher?

No. Sponsors cannot buy, alter, or delay a ranking, test, or review. Sponsored placements, when they exist, will be labeled and kept outside the ranked list.

Does Loadout use affiliate links?

Not today. Every "Official site" button links straight to the vendor. If affiliate links are ever added, they will be disclosed on every page that uses them, and tools without an affiliate program get the same placement.

Where do the prices come from?

They're quoted as stated on each vendor's pricing page or help center on the verified date shown, with the source URL. Prices change, so check the vendor page before buying.

Can I reuse the data?

Yes. Rankings, Agent-Ready scores and test-log summaries are published as read-only JSON at /rankings.json. Please attribute "Data from Loadout".

How do I suggest a tool?

See the Submit a tool page. Submissions aren't open yet, and submitting never affects rank.

More: methodology v0.2 · test logs · movers · disclosures