Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemrfm0227_1.png

What is the date written in the ‘slip’?

OCR text of the page · 290 characters; the scanned image itself is not published
For WJD
Date 12 20
Time 9:50
WHILE YOU WERE OUT
M Laura Harrill
From U. of Tenn.
Phone No 615 - 974- 3491
Area Code
Number
Extension
TELEPHONED
URGENT
PLEASE CALL
WANTS TO SEE YOU
WILL CALL AGAIN
CAME TO SEE YOU
RETURNED YOUR CALL
Message
we Halland
Desithy ballad - Kraft
Operator
S
im0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
12/20
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.80

12 20

5 characters6 tokens

Aux 2015

Wrong

For WJD Date 12 20 Time 9:50 WHILE YOU WERE OUT M Laura Harrill From U. of Tenn. Phone No 615 - 974- 3491 Area Code Number Extension TE

135 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Wrong

12 20 Time 9:50

Question:

What is the date written in the ‘slip’?

OCR text: For WJD Date 12 20 Time 9:50

12 20

118 characters54 tokens