Evally
Start free
Research & data

Survey response coder

Code open-ended survey answers into themes and sentiment, thousands at a time.

Turns free-text answers into data: each response is tagged with every theme it mentions (a response can have several), a sentiment, and whether it suggests a specific change. Edit the themes to match your codebook, then run your whole export as a batch.

Use this judgeCustomize it

Try it live

Real calls to Jev. Pick an example or paste your own.

Examples
36
139
No verdict yet

Pick an example or paste your own input, then run it.

Under the hood

Every question and rule, in the open. Fork it to change any of them.

What it asks

Reads question and response, then asks 8 questions in one call.

  1. Q1Theme: priceYes / no

    Does the response talk about price, cost or value for money?

  2. Q2Theme: ease of useYes / no

    Does the response talk about how easy or hard the product is to use?

  3. Q3Theme: featuresYes / no

    Does the response ask for or discuss specific features?

  4. Q4Theme: supportYes / no

    Does the response talk about customer support or service?

  5. Q5Theme: speed & reliabilityYes / no

    Does the response talk about speed, bugs, outages or reliability?

  6. Q6Theme: getting startedYes / no

    Does the response talk about setup, onboarding or learning the product?

  7. Q7SentimentPick one

    What is the overall sentiment of the response?

    PositiveNegativeMixedNeutral
  8. Q8Suggests a changeYes / no

    Does the response suggest a specific change the team could make?

How it decides

Rules run in code, top to bottom. The first one that matches gives the verdict.

  1. 1
    Otherwisethe answer to “Sentiment”
  2. ·
    DefaultNeutral

Call it from your code

Every template runs as-is with an API key, no setup: POST /api/v1/judges/survey-coder/run.

curl -X POST https://tryevally.com/api/v1/judges/survey-coder/run \  -H "Authorization: Bearer $EVALLY_API_KEY" \  -H "Content-Type: application/json" \  -d '{  "input": {    "question": "What'\''s one thing we could do better?",    "response": "The app is great once you get going, but setup took me two days and support took 48 hours to reply. For $49 a month I expected faster help."  }}'

Seen in the wild

Community builds on Jev that use this pattern. Not affiliated with Evally.

More in Research & data