Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelpdl0226_13.png

What is the total number of respondents?

OCR text of the page · 613 characters; the scanned image itself is not published
Question 3: In your opinion, how many calories are there in a:
Teaspoon of sugar, pat of butter, slice of bread,
medium size potato.
Total
Men
Women
Total Respondents
(506=100%) (249=100%) (257=1.00%)
Calories in teaspoon
of sugar: (18 calories)
Under 16
8%
16 & 17
18
1
19 & 20
13
21 to 50
11
50 to 100
16
100 to 200
17
200 and over
16
OO N OO N WI :
20
Don't know.
24
29
18
Calories in pat of butter:
(50 calories)
Under 25
10%
10%
25 to 40
9
8
119
11
40 to 60
16
19
60 to 75
75 to 100
7
100 and over
27
25
Don't know
27
32
22
Question 3: Continued -
ce. Tittps.1/ www.industrydocuments. ucsT. eau/docs/1pa10Zz6
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
506
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

506

3 characters4 tokens

Aux 2015

Wrong

20

2 characters3 tokens

PiT-FT 2015

Wrong

<|<|<|<|<|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

64 characters64 tokens

ChronoGPT 2015

Wrong

Question 4: What is the total number of respondents?

Question 4: What is the total number of respondents?

Question 4: What is the total number of respondents?

Question 5: What is the total number of respondents?

233 characters64 tokens