Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehjpj0226_3.png

Which agency approval is required for product usage?

OCR text of the page · 3,371 characters; the scanned image itself is not published
INGREDIENT DATA
Pepsi-Cola Product Information
Ingredients are given per fluid ounce of bottled or canned beverage
Mandarin Diet Mandarin
Diet
Component
Slice
Diet Slice Orange Slice Orange Slice Apple Slice Apple Slice Cola Slice
Cherry
Diet Cherry
Cola Slice
Calories
12.7
2.2
16.1
1.6
16.3
1.7
13.7
1.7
Water, gms.
27.4
29.0
25.6
29.1
25.7
29.1
26.1
29.1
Carbohydrates/Sugars, 2 gms.
3.3
0.5
4.2
0.35
4.0
0.4
3.6
0.4
Phosphorus, mgs.
0
0
0
0
0
0
5.0
5.0
Caffeine, mgs. 3
0
0
0
0
0
0
0.04
0.04
Potassium, mgs. 4
8.3
8.3
10.0
7.1
7.4
5.6
5.6
5.6
Sodium, mgs. 4
0.9
0.9
1.8
1.8
0.4
0.4
0.4
0.4
Benzoic Acid, mgs.
8.7
8.7
9.5
8.8
9.5
8.8
8.7
8.7
Aspartame, mgs.
0
11.38
O
15.59
0
14.17
0
14.04
1. These products contain negligible amounts of iron,
calcium, protein, starch, fiber, fat or vitamins
Only the finest ingredients are used in
the production of Pepsi-Cola Company
Slice is one of the most successful soft
2. Regular soft drinks (other than Diet Slice, Diet
Mandarin Orange Slice, Diet Apple Slice, and Diet
drink brand introductions of the past
Cherry Cola Slice) are sweetened primarily with high
beverages. All ingredients are safe and
approved for use by the Federal Food
20 years. With 10% fruit juice, Slice
fructose corn syrup, but sucrose, medium invert
sugar or blends of these sweeteners are also used
and Drug Administration (FDA).
is more than just another carbonated
In the finished product, these sugars result in a
soft drink - its introduction created
mixture of fructose, glucose and sucrose.
3. Caffeine is not added to Cherry Cola Slice or
a whole new category of soft drink.
Diet Cherry Cola Slice. There are trace amounts of
To guarantee our consumers consis-
caffeine present due to the addition of natural cola
tent quality, each ingredient must pass
flavors. For comparison, decaffeinated coffee contains
0.6 milligrams of caffeine per fluid ounce: Cherry
Pepsi-Cola high standards, rigorous
The Slice line now includes a four-
quality control tests, and strict bottling
flavor portfolio which establishes Pepsi-
Cola Slice contains 93% less caffeine than the
procedures. All ingredients are listed
Cola's leadership position in this new
amount found in decaffeinated coffee
4. Sodium and potassium contributions do not
soft drink category: the original Lemon-
include the contribution from water and sugars used
on the label in order of decreasing
Lime Slice, Mandarin Orange Slice,
at the bottling plant, which will vary according to
the local supply. For comparison, most lo
amount.
Cherry Cola Slice and Apple Slice. Diet
supplies contain less than 3.0 milligrams of sodium
per fluid ounce, making soft drinks contribute an
All Slice products contain a 10% blend
versions of all Slice flavors are
average of less than 1% of estimated daily sodium
sweetened with 100% NutraSweet.
intake. Values for Slice products are calculated using
of one or more fruit juices plus natural
the average contribution from juice.
flavors to further enhance their taste.
These flavors include extracts of the
Slice is a natural for consumers who
Date: October, 1986
kola nut, vanilla beans and flavor oils
are looking for the added value of real
derived from natural sources such as
fruit juice in their soft drinks.
oranges, lemons and limes.
PEPS
PEPSI-COLA COMPANY, PURCHASE, NEW YORK 10577
Source: https://www.industrydocuments.ucsf.edu/docs/hjpj0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Food and Drug Administration(FDA)
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.79

Federal Food and Drug Administration (FDA)

42 characters9 tokens

Aux 2015

Wrong

INGREDIENT DATA Pepsi-Cola Product Information Ingredients are given per fluid ounce of bottled or canned beverage Mandarin Diet Mandarin Diet Component Slice Diet Slice Orange Slice Orange Slice Apple Slice Apple Slice Cola Slice Cherry Diet Cherry Cola Slice Calories 12

272 characters64 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

Caffeine, mgs.

Ingredients:

  • Sugar, gms.
  • Sugar, gms.
  • Sugar, gms.
  • Sugar, gms.
  • Sugar, gms.
  • Sugar, gms.
  • Sugar, gms.
  • Sugar
138 characters64 tokens