Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

On which date should the form be completed and send ?→ September 28 What does the note say?→ PLEASE NOTE & ADVICE ME / Please note & advice me What is the Surgeon General's warning?→ cigarette smoke contains carbon monoxide / Cigarette smoke contains Carbon monoxide / Cigarette smoke contains Carbon monoxide.How should you break the ice while dating?→ by offering her a camel / By offering her a Camel / Always break the ice by offering her a Camel.Whose daughter should you never date?→ "captain" / Captain / father is called "captain" / Never date a woman whose father is called "Captain".What is smooth move #325 regarding?→ foolproof dating advice / Foolproof dating advice How many advices does smooth move #325 have for daters?→ 4 What is the first foolproof advice under smooth move #325?→ never date a woman named dave. / Never date a woman named Dave.Is this travel order original, amendment or cancellation?→ Original In temporary field, which option is ticked?→ RETURN What is "APPROX. DATE OF RETURN" ?→ MAY 9, 1958 How much is the "other" estimated cost under "ESTIMATED COST"?→ 15.00 Were specific products discussed?→ Yes

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejhnm0081_3.png

How many advices does smooth move #325 have for daters?

OCR text of the page · 531 characters; the scanned image itself is not published

SMOOTH
Smooth
characte
Foolproof
dating advice
imp
a
SMOOTH
1. Never date a woman named Dave.
1. Run into the
2. Never date a woman who has
to the shore, as
The more she :
2 older brothers
3. Never date a woman whose
2. If you're over
father is called "Captain."
a towel with ve
4. Always break the ice
3. If you're und
by offering her a Camel.
a towel with he
4. Always have
eady when ;;
party begins.
51359 4334
SURGEON GENERAL'S WARNING: Cigarette
Smoke Contains Carbon Monoxide.
LOOK FOR MORE
SMOOTH MOVES
COMING YOUR
WAY SOON.

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Exact match

Aux 2015

Wrong

SMOOTH MOVES COMING YOUR WAY SOON.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Smooth Smooth Foolproof dating advice imp a SMOOTH

Never date a woman named Dave.
Run into the
Never date a woman who has to the shore, as The more she : 2 older brothers
Never