Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehybl0226_1.png

Which is the national brand beginning with the letter T?

OCR text of the page · 862 characters; the scanned image itself is not published
OVERVIEW OF OTC CALCIUM SUPPLEMENT CATEGORY
National Brands (at least 9):
General Nutrition Center
Nature Made
Caltrate
Os-Cal
Your Life
Centrum
Avail
Citracal
Posture
Tums
Regional Brands ( Dozens of Calcium Products): Food Stores (Grocery)
Drug Stores (e.g. Super X)
Mass Merchandising (e.g. Kmart)
*Total Sales For Entire Food/Drug/Mass Merchant 1992: $115 MM (Lead Brand Os-Cal $25 MM)
Estimated Profit Margin:
10%
Estimated Profit For Entire Calcium Category: $11.5 MM
Raw Material Costs: Ingredient.
CCM Plus Trace Minerals Current Products
Cost Index
Zinc
Zinc Sulfate
Zinc Oxide
42
Manganese
Manganese Gluconate
Manganese Oxide
2.6
Copper
Copper Gluconate
Copper Oxide
8.3
Calcium
CCM
Calcium Carbonate
6.0 (estimated)
* Kline & Company Report on Vitamin and Nutiritional Supplements.
MBA 3/94
Source: https://www.industrydocuments.ucsf.edu/docs/hybl0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Tums
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Tums

4 characters3 tokens

Aux 2015

Wrong

T

1 characters2 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

National Brands (at least 9): General Nutrition Center Nature Made Caltrate Os-Cal Your Life Centrum Avail Citracal Posture Regional Brands ( dozens of Calcium Products): Food Stores (Grocery) Drug Stores (e.g

209 characters64 tokens