Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemndw0217_29.png

What is the heading of Table 4?

OCR text of the page · 455 characters; the scanned image itself is not published
29
Table 4. Ten of the Estrogenic Compounds Identified and Quantified in Premarin
Sodium Estrogen Sulfate
mg/0.625 mg Tablet*
Estrone
).370
Equilin
0.168
17a-Dihydroequilin
0.102
170-Estradiol
0.027
178-Dihydroequilin
0.011
17a-Dihydroequilenin
0.011
170-Dihydroequilenin
0.021
Equilenin
0.015
173-Estradiol
.005
48,9-Dehydroestrone
0 026
*From FDA CDER Memorandum, May 5, 1997,25
DWRITE 077987
Source: https://www.industrydocuments.ucsf.edu/docs/mndw0217
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
ten of the estrogenic compounds identified and quantified in premarinTen of the estrogenic compounds identified and quantified in Premarin
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Ten of the Estrogenic Compounds Identified and Quantified in Premarin

69 characters16 tokens

Aux 2015

Wrong

29

2 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Table 4. Ten of the Estrogenic Compounds Identified and Quantified in Premarin Sodium Estrogen Sulfate mg/0.625 mg Tablet* Estrone

Table 4. Ten of the Estrogenic Compounds Identified and Quantified in Premarin

211 characters64 tokens