Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepgjw0227_5.png

What is the title of the table?

OCR text of the page · 1,307 characters; the scanned image itself is not published
SOME CALCIUM SALTS
Tablet
Equivalent of 1 Gram
Cost of One
Drug
Size
Calcium per Day
Months' Dosage*
Calcium carbonate (40% calcium)
generic - Lilly
600 mg
4 tablets
$ 3.60
- Rugby
600 mg
4 tablets
.51
(Alka-2 - Miles)
500 mg
5 tablets
3.66
(Amitone - Norcliff Thayer)
350 mg
7 tablets
3.70
(Equilet - Mission)
500 mg
5 tablets
3.60
Dicarbosil - Norcliff Thayer)
500 mg
5 tablets
3.40
(Mallamint - Mallard)
420 mg
6 tablets
3.75
(OsCal - Marion)
1250 mg
2 tablets
5.75
Calcium gluconate (9% calcium)
generic - average price
600 mg
18.5 tablets
8.7
range $2.19 [Rosow]
1000 mg
11 tablets
to $22.11 [Lilly])
650 mg
17 tablets
930 mg
12 tablets
Calcium lactate (13% calcium)
generic - average price
600 mg
13 tablets
4.80
(range $1.70 [Rosow]
648 mg
12 tablets
to $10.80 [Lilly])
650 mg
12 tablets
Calcium glucobinate (6.5% calcium)
(Neo-Calglucon - Dorsey)
1800 mg/5 ml
9 teaspoonsful
16.65
Dibasic calcium phosphate (23.3% Calcium)
generic - average price
600 mg
9 tablets
1.35
(range 73c [Interstate]
to $3.63 [Lilly])
Chelated calcium (20% calcium)
generic - Arco
750 mg
7 tablets
4.58
- Bio-Nutritional
4.02
- Nature's Bounty
7.04
* Cost to the pharmacist for 30 grams of calcium, based on manufacturers' listings in Drug Topics Red Book, 1982.
Source: https://www.industrydocuments.ucsf.edu/docs/pgjw0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
SOME CALCIUM SALTSSome Calcium Salts
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

SOME CALCIUM SALTS

18 characters8 tokens

Aux 2015

Wrong

The table shows the cost of 1 gram of calcium salts, based on the manufacturer's listings in the Drug Topics Red Book, 1982.

124 characters33 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

Tablet Drug Drug Drug Drug Drug Drug Drug Drug

46 characters18 tokens