Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemswg0227_11.png

How many eggs do they intake daily?

OCR text of the page · 1,102 characters; the scanned image itself is not published
LOW CARBOHYDRATE DIET ----- Plan I
GIRLS -- Ages 13 to 17 yrs.
Total Daily Intake
_ quart milk
or more eggs
servings meat, fish, or fowl
or 4 strips bacon
cup puffed wheat or puffed rice
1 or 12 cups 20%% cream
5 or more servings butter or olco.
1 serving of tomato, orange, or grapefruit juice (or the whole fruit-
no sugar)
2 servings of any of the following: asparagus, broccoli, carrots, spinach,
tomatoes, green beans, or winter squash
1 additional serving of a vegetable chosen from the above or cabbage,
cauliflower, egg plant, or beets
2 servings of a water-packed fruit or an apple or melon, or berries in
season (with saccharin - no sugar)
Sample Menu
Breakfast
Lunch
1 glass orange juice
1 egg with bacon
1 slice roast
1 hard boiled egg
1 cup puffed wheat
3/4 cup cream - 20%
carrot and celery sticks
1 glass milk
1 apple
1 glass milk
Afternoon
Dinner
1 glass 2 milk-zcream
1 serving moat
1 slice choose
1 serving green beans with butter
or
1 dish tomatoes
1 hard boiled ogg
1 glass milk
1 serving water-packed fruit
237.5 2/49 DH
Source: https://www.industrydocuments.ucsf.edu/docs/mswg0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
2 OR MORE2 or more
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

or more eggs

12 characters4 tokens

Aux 2015

Wrong

12 eggs

7 characters4 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCR text: LOW CARBOHYDRATE DIET ** GIRLS -- Ages 13 to 17 yrs. Total Daily Intake _ quart milk or more eggs _ quart milk _ 1 cup milk _ 1 cup milk _ 1 cup milk _ 1 cup milk

172 characters64 tokens