Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegnvl0226_2.png

What is the weight of one shell?

OCR text of the page · 1,706 characters; the scanned image itself is not published
CODE 6170
7/21/82
SCHOOL LUNCH COOKED SAUSAGE PIZZA
COMPONENT
WEIGHT
shell 3.2" x 5" (thin formulal)
Sauce 101
140 02
0.98 02.
Meat
225
0.60 02.
Cheese 564
1. 52 oz.
NET WEIGHT
4.50 oz.
PROCEDURE
Place shell on conveyer, dispense sauce over shell, meat over
sauce and cheese over meat.
Pizza is blast frozen, cased and
held in freezer.
MATERIAL
PACK
Case 195* x 114" x 8"
10 high-10 across
z divider ]1" x 8"
100/4.5 oz. pizzas
poly Bag 22" x 20" x 30" x.0015"
28. 13 1bs. Net Wt.
poly Sheets 20" x 7" x.0015"
Label 617C
KEEP FROZEN
Sabatasso's 4.50 oz, Cooked Sausage
Pizza (containing 0.51 oz. equivalent
as by the United States Department
or exchange
cooked meat and 1,49 oz, cheddar
and Mozzarella cheese and 1.40 oz. of
enriched pizza crust) provides 2 oz.
SCHOOL LUNCH
equivalent meat/meat alternate and
1
serving of bread for Type A Pat-
COOKED SAUSAGE PIZZA
tern requirements. (April, 1982)
INGREDIENTS: TOPPING (Cheddar cheese, moz
zarella cheese, corn starch, salt, onion powder,
617C
hydrolyzed plant protein, spices, garlic powder,
romano cheese [made from cow's milk]). CRUST
(Unbleached enriched flour, water, vegetable short-
ening (soybean oil], yeast, salt, malt, wheat germ),
SAUCE (Water, tomato paste, modified food starch,
U. S.
INSPECTED
AND PASSED
100 PIZZAS
seasoning Isalt, sugar, spices, romano cheese
(made from cow's milk), onion powder], dextrose.
DEPARTMENT OF
AGRICULTURE
3.2" x 5"*
paprika, salt, citric acid, beet powder), COOKED
EST. 7645
4.5 OZ. EACH
PORK SAUSAGE (Ground pork [no more than 24 9%)
tat], water, salt, spices, dextrose, flavorings).
NET WT. 28.13 LBS.
SABATASSO FOODS
SANTA ANA, CALIFORNIA 92707
Source: https://www.industrydocuments ucsf.edu/docs/gnv10226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1.40 oz.
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

1.40 oz.

8 characters7 tokens

Aux 2015

Wrong

The question asks for the weight of one shell of the pizza.

Looking at the provided OCR text, I see:

  • "CODE 6170"
  • "7/21/82"
  • "SCHOOL LUNCH COOKED SAUSAGE PIZZA"
  • "COMP
174 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Sauce 101 Sauce 102 Sauce 103 Sauce 104 Sauce 105 Sauce 106 Sauce 107 Sauce 108 Sauce 109 Sauce 110 Sauce 111 Sauce 112 Sauce 113

129 characters64 tokens