Evally
AI output quality

Claim vs evidence

Does the evidence support the claim, contradict it, or not settle it? With the sentence that decides.

The judging step of a fact-checker or a research agent: one claim and the text you found for it. Jev says whether the evidence supports the claim, contradicts it, backs only part of it or doesn't settle it, checks that numbers, dates and names match, and quotes the sentence that decides. Extract claims and search however you like; this is the step that has to be right.

Try it live

Real calls to Jev. Pick an example or paste your own.

Examples
48
135
No verdict yet

Pick an example or paste your own input, then run it.

Under the hood

Every question and rule, in the open. Fork it to change any of them.

What it asks

Reads claim and evidence, then asks 3 questions in one call.

  1. Q1StancePick one

    Taking the evidence at its word, what does it say about the claim?

    SupportsContradictsPartlyDoesn't say
  2. Q2One sentence decides itYes / no quotes evidence

    Does a single sentence of the evidence settle the claim on its own?

  3. Q3Details matchYes / no

    Where the claim gives numbers, dates, names or places, does the evidence give the same ones? If the claim has none, answer yes.

How it decides

Rules run in code, top to bottom. The first one that matches gives the verdict.

  1. 1
    If Stance is Contradicts and Stance: confidence ≥ 0.5Contradicted
  2. 2
    If Stance is Supports and Stance: confidence ≥ 0.6 and Details match ≥ 0.5Supported
  3. ·
    DefaultNot settled

Call it from your code

Every template runs as-is with an API key, no setup: POST /api/v1/judges/evidence-check/run.

curl -X POST https://tryevally.com/api/v1/judges/evidence-check/run \  -H "Authorization: Bearer $EVALLY_API_KEY" \  -H "Content-Type: application/json" \  -d '{  "input": {    "claim": "The Hubble Space Telescope was launched in 1990.",    "evidence": "The Hubble Space Telescope was carried into low Earth orbit in April 1990 aboard the Space Shuttle Discovery. It is still in operation."  }}'

Seen in the wild

Community builds on Jev that use this pattern. Not affiliated with Evally.

More in AI output quality