Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekzng0227_48.png

Which food contains 30 mg./100g. of Sodium ?

OCR text of the page · 1,243 characters; the scanned image itself is not published
Sodium .
Sodium
FOOD
mg./ 100g%
FOOD
mg./ 100g.
Oils (corn, cottonseed, cod-
Prunes, raw
liver, olive, peanut,
Canned
22
etc.)
negligible
Dried
6
Okra, raw
1.
Prune juice
2
Olives, pickled
2000a
:Pumpkin, raw
Onions
10b
Rabbit
40 ..
Oranges
1
Radish
15b
Orange juice, canned
1
Raisins
25
Parsley, raw
30
Raspberries, raw
T
Canned
Parsnips, raw
.8.
Rhubarb, raw
12
Peaches, raw
80. end goal ,aFrozen
2
Frozen
3
Canned
28 / ."Rice; dry, polished
2
Peanuts, roasted, unsalted
13 1: Sauerkraut, canned
:650a
Peanut butter, prepared without
added sodium
52,
: Shortening ("Crisco, " "Spry, "
lard, etc. )
" negligible
Pears, raw
2
Sirup, corn ("Karol)
Canned
Maple
14:
Sorghum
20b.
Peas, raw
Table blends
Frozen
variable.
Canned without added
Soybeans, dry
4
salt
Dried
20b
Spaghetti, plain
:56
Pecans, raw
Spices and herbs (all spices,
with the exceptions of
Peppers, green, raw
celery seed and flakes,
and parsley flakes may
Pineapple, raw
be used in low-sodium
Frozen
diets)
Canned
Spinach, raw
85b
Pineapple juice, canned
. Canned without salt
60ab
Frozen
806
Plums, raw
1.5
Canned
Squash, raw, all types
1
Pork, lean, raw
55 0
Starch, corn
Potatoes, white, raw
3 Strawberries, raw
1
Source: https://www.industrydocuments.ucsf.edu/docs/kzng0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
parsley, rawParsley, raw
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Parsley, raw

12 characters6 tokens

Aux 2015

Wrong

Sodium

6 characters3 tokens

PiT-FT 2015

Wrong

<|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant <|assistant

155 characters64 tokens

ChronoGPT 2015

Wrong

Sodium . Sodium

15 characters6 tokens