Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemndw0217_29.png

What is the date mentioned at the footnote of the table?

OCR text of the page · 455 characters; the scanned image itself is not published
29
Table 4. Ten of the Estrogenic Compounds Identified and Quantified in Premarin
Sodium Estrogen Sulfate
mg/0.625 mg Tablet*
Estrone
).370
Equilin
0.168
17a-Dihydroequilin
0.102
170-Estradiol
0.027
178-Dihydroequilin
0.011
17a-Dihydroequilenin
0.011
170-Dihydroequilenin
0.021
Equilenin
0.015
173-Estradiol
.005
48,9-Dehydroestrone
0 026
*From FDA CDER Memorandum, May 5, 1997,25
DWRITE 077987
Source: https://www.industrydocuments.ucsf.edu/docs/mndw0217
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
may 5, 1997May 5, 1997
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

May 5, 1997

11 characters10 tokens

Aux 2015

Wrong

077987

6 characters7 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Table 4. Ten of the Estrogenic Compounds Identified and Quantified in Premarin Sodium Estrogen Sulfate mg/0.625 mg Tablet* Estrone

Table 4. Ten of the Estrogenic Compounds Identified and Quantified in Premarin

211 characters64 tokens