Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepgjw0227_5.png

Which calcium salt has Highest percentage of Calcium?

OCR text of the page · 1,307 characters; the scanned image itself is not published
SOME CALCIUM SALTS
Tablet
Equivalent of 1 Gram
Cost of One
Drug
Size
Calcium per Day
Months' Dosage*
Calcium carbonate (40% calcium)
generic - Lilly
600 mg
4 tablets
$ 3.60
- Rugby
600 mg
4 tablets
.51
(Alka-2 - Miles)
500 mg
5 tablets
3.66
(Amitone - Norcliff Thayer)
350 mg
7 tablets
3.70
(Equilet - Mission)
500 mg
5 tablets
3.60
Dicarbosil - Norcliff Thayer)
500 mg
5 tablets
3.40
(Mallamint - Mallard)
420 mg
6 tablets
3.75
(OsCal - Marion)
1250 mg
2 tablets
5.75
Calcium gluconate (9% calcium)
generic - average price
600 mg
18.5 tablets
8.7
range $2.19 [Rosow]
1000 mg
11 tablets
to $22.11 [Lilly])
650 mg
17 tablets
930 mg
12 tablets
Calcium lactate (13% calcium)
generic - average price
600 mg
13 tablets
4.80
(range $1.70 [Rosow]
648 mg
12 tablets
to $10.80 [Lilly])
650 mg
12 tablets
Calcium glucobinate (6.5% calcium)
(Neo-Calglucon - Dorsey)
1800 mg/5 ml
9 teaspoonsful
16.65
Dibasic calcium phosphate (23.3% Calcium)
generic - average price
600 mg
9 tablets
1.35
(range 73c [Interstate]
to $3.63 [Lilly])
Chelated calcium (20% calcium)
generic - Arco
750 mg
7 tablets
4.58
- Bio-Nutritional
4.02
- Nature's Bounty
7.04
* Cost to the pharmacist for 30 grams of calcium, based on manufacturers' listings in Drug Topics Red Book, 1982.
Source: https://www.industrydocuments.ucsf.edu/docs/pgjw0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
CALCIUM CARBONATECalcium carbonate
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Calcium carbonate

17 characters4 tokens

Aux 2015

Wrong

The question asks which calcium salt has the highest percentage of calcium.

Let's analyze the provided text:

  • Tablet: 600 mg, 4 tablets, $3.60
  • Rugby: 600 mg, 4 tablets, $0.51
187 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Calcium gluconate (9% calcium)

30 characters11 tokens