Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehybl0226_1.png

What is the estimated profit margin?

OCR text of the page · 862 characters; the scanned image itself is not published
OVERVIEW OF OTC CALCIUM SUPPLEMENT CATEGORY
National Brands (at least 9):
General Nutrition Center
Nature Made
Caltrate
Os-Cal
Your Life
Centrum
Avail
Citracal
Posture
Tums
Regional Brands ( Dozens of Calcium Products): Food Stores (Grocery)
Drug Stores (e.g. Super X)
Mass Merchandising (e.g. Kmart)
*Total Sales For Entire Food/Drug/Mass Merchant 1992: $115 MM (Lead Brand Os-Cal $25 MM)
Estimated Profit Margin:
10%
Estimated Profit For Entire Calcium Category: $11.5 MM
Raw Material Costs: Ingredient.
CCM Plus Trace Minerals Current Products
Cost Index
Zinc
Zinc Sulfate
Zinc Oxide
42
Manganese
Manganese Gluconate
Manganese Oxide
2.6
Copper
Copper Gluconate
Copper Oxide
8.3
Calcium
CCM
Calcium Carbonate
6.0 (estimated)
* Kline & Company Report on Vitamin and Nutiritional Supplements.
MBA 3/94
Source: https://www.industrydocuments.ucsf.edu/docs/hybl0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
10%
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

10%

3 characters4 tokens

Aux 2015

Exact match

10%

3 characters4 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Calcium Supplements

OCR Text:

OCR Text:

OCR Text:

OCR Text:

OCR Text:

OCR Text:

OCR Text:

OCR Text:

OCR Text:

OCR

158 characters64 tokens