Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemndw0217_29.png

How many mg of equilin is found in 0.625 mg tablet ?

OCR text of the page · 455 characters; the scanned image itself is not published
29
Table 4. Ten of the Estrogenic Compounds Identified and Quantified in Premarin
Sodium Estrogen Sulfate
mg/0.625 mg Tablet*
Estrone
).370
Equilin
0.168
17a-Dihydroequilin
0.102
170-Estradiol
0.027
178-Dihydroequilin
0.011
17a-Dihydroequilenin
0.011
170-Dihydroequilenin
0.021
Equilenin
0.015
173-Estradiol
.005
48,9-Dehydroestrone
0 026
*From FDA CDER Memorandum, May 5, 1997,25
DWRITE 077987
Source: https://www.industrydocuments.ucsf.edu/docs/mndw0217
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
0.168
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

0.168

5 characters6 tokens

Aux 2015

Wrong

0.015

5 characters6 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

0.125 mg of equilin is found in 0.625 mg tablet.

48 characters17 tokens