Evally
Start free
Recruiting

Application reviewer

Find evidence of real work in thousands of applications, not polished filler.

For internships, fellowships and accelerators with more applications than reviewers: looks for real projects with specifics, the effort that went in, fit with the role, whether the application follows your instructions, and generic AI-written filler.

Use this judgeCustomize it

Hiring decisions affect people's livelihoods and are regulated in many places (for example New York City's automated employment decision rules). Use this to organize evidence for a person who makes the decision, never to reject candidates automatically, and never add questions about age, gender, ethnicity, religion, disability, family status or other protected traits.

Try it live

Real calls to Jev. Pick an example or paste your own.

Examples
78
237
No verdict yet

Pick an example or paste your own input, then run it.

Under the hood

Every question and rule, in the open. Fork it to change any of them.

What it asks

Reads role and application, then asks 5 questions in one call.

  1. Q1Evidence of real workYes / no quotes evidence

    Does the application point to real work the applicant did (a project, repository, portfolio, publication or product) with specifics?

  2. Q2EffortScore

    How much effort went into the application?

    1. 0Copy-paste or blank
    2. 1Minimal
    3. 2Thoughtful
    4. 3Exceptional
  3. Q3FitScore

    How well does the applicant's background fit the role?

    1. 0No fit
    2. 1Some fit
    3. 2Good fit
    4. 3Excellent fit
  4. Q4Generic AI fillerYes / no

    Does the application read as generic AI-generated text with no personal details?

  5. Q5Followed instructionsYes / no

    Does the application include what the role asked applicants to include?

How it decides

Rules run in code, top to bottom. The first one that matches gives the verdict.

  1. 1
    If Application score ≥ 68Shortlist
  2. 2
    If Application score ≥ 45Maybereview
  3. ·
    DefaultNot now
Application score

A 0-100 score weighted from Evidence of real work ×3, Effort ×2, Fit ×3, Generic AI filler (inverted) ×1, Followed instructions ×1.

Call it from your code

Every template runs as-is with an API key, no setup: POST /api/v1/judges/application-reviewer/run.

curl -X POST https://tryevally.com/api/v1/judges/application-reviewer/run \  -H "Authorization: Bearer $EVALLY_API_KEY" \  -H "Content-Type: application/json" \  -d '{  "input": {    "role": "Software engineering intern. Tell us about something you built and link to it.",    "application": "I built a Discord bot that transcribes voice channels with Whisper and posts summaries; it'\''s used by 40 servers (github.com/ana-dev/scribe). The hardest part was cutting GPU cost: batching audio chunks brought it from $90 to $12 a month."  }}'

Seen in the wild

Community builds on Jev that use this pattern. Not affiliated with Evally.

More in Recruiting