Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemndw0217_29.png

How many mg of estrone is found in 0.625 mg tablet ?

OCR text of the page · 455 characters; the scanned image itself is not published
29
Table 4. Ten of the Estrogenic Compounds Identified and Quantified in Premarin
Sodium Estrogen Sulfate
mg/0.625 mg Tablet*
Estrone
).370
Equilin
0.168
17a-Dihydroequilin
0.102
170-Estradiol
0.027
178-Dihydroequilin
0.011
17a-Dihydroequilenin
0.011
170-Dihydroequilenin
0.021
Equilenin
0.015
173-Estradiol
.005
48,9-Dehydroestrone
0 026
*From FDA CDER Memorandum, May 5, 1997,25
DWRITE 077987
Source: https://www.industrydocuments.ucsf.edu/docs/mndw0217
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
0.370
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.80

.370

4 characters5 tokens

Aux 2015

Wrong

0.625 mg tablet

15 characters8 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

0.625 mg tablet* Estrone

Question:

How many mg of estrone is found in 0.625 mg tablet?

OCR text: 29 Table 4. Ten of the Estrogenic Compounds Identified and Quantified in Premarin Sodium Estrogen S

202 characters64 tokens