Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepgjw0227_5.png

How many OsCal tablets equals 1g of Calcium?

OCR text of the page · 1,307 characters; the scanned image itself is not published
SOME CALCIUM SALTS
Tablet
Equivalent of 1 Gram
Cost of One
Drug
Size
Calcium per Day
Months' Dosage*
Calcium carbonate (40% calcium)
generic - Lilly
600 mg
4 tablets
$ 3.60
- Rugby
600 mg
4 tablets
.51
(Alka-2 - Miles)
500 mg
5 tablets
3.66
(Amitone - Norcliff Thayer)
350 mg
7 tablets
3.70
(Equilet - Mission)
500 mg
5 tablets
3.60
Dicarbosil - Norcliff Thayer)
500 mg
5 tablets
3.40
(Mallamint - Mallard)
420 mg
6 tablets
3.75
(OsCal - Marion)
1250 mg
2 tablets
5.75
Calcium gluconate (9% calcium)
generic - average price
600 mg
18.5 tablets
8.7
range $2.19 [Rosow]
1000 mg
11 tablets
to $22.11 [Lilly])
650 mg
17 tablets
930 mg
12 tablets
Calcium lactate (13% calcium)
generic - average price
600 mg
13 tablets
4.80
(range $1.70 [Rosow]
648 mg
12 tablets
to $10.80 [Lilly])
650 mg
12 tablets
Calcium glucobinate (6.5% calcium)
(Neo-Calglucon - Dorsey)
1800 mg/5 ml
9 teaspoonsful
16.65
Dibasic calcium phosphate (23.3% Calcium)
generic - average price
600 mg
9 tablets
1.35
(range 73c [Interstate]
to $3.63 [Lilly])
Chelated calcium (20% calcium)
generic - Arco
750 mg
7 tablets
4.58
- Bio-Nutritional
4.02
- Nature's Bounty
7.04
* Cost to the pharmacist for 30 grams of calcium, based on manufacturers' listings in Drug Topics Red Book, 1982.
Source: https://www.industrydocuments.ucsf.edu/docs/pgjw0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
2 TABLETS2 tablets
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

2 tablets

9 characters3 tokens

Aux 2015

Wrong

The question asks: "How many OsCal tablets equals 1g of Calcium?"

We are given a list of tablets and their corresponding amounts of calcium per tablet. We need to find the number of tablets that equal 1g of calcium.

Let's examine each tablet:

  1. **OsCal tablets
264 characters64 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

Oxygen Oxygen Oxygen Oxygen Oxygen

34 characters19 tokens