Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageslmg0227_14.png

What is plotted along the y axis of fig 1?

OCR text of the page · 504 characters; the scanned image itself is not published
EFFECT OF DIET ON FOOD CONSUMED IN
COLD- AND WARM- ACCLIMATIZED RATS
19
MEAN GRAMS FOOD CONSUMED DAILY
18
17 -
4 C
Fructose
- 24"C
Glucose
24%
12
75
20
40
PERCENT PROTEIN IN DIET
FIGURE 1
FOOD CONSUMED
CALORIC EFFICIENCY = Mean Daily Body Weight Gain (Gm)
the Mean Daily Food Consumption (Gm)
9 1 Gm of each diet. 4.366 Calories
Glucose o ) 24 " C
Fructose
CALORIC EFFICIENCY x 100
fructose
Glucose
20
PERCENT PROTEIN IN DIET
40
FIGURE 2
CALORIC EFFICIENCY
- 13 -
Source:
rydocuments.ucsf.edu/docs/simg02
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
MEAN GRAMS FOOD CONSUMED DAILYMean grams food consumed daily
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Mean grams food consumed daily

30 characters6 tokens

Aux 2015

Wrong

The y axis of fig 1 is plotted along the y axis.

48 characters15 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER

39 characters24 tokens