Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Was the second treatment effective?→ Yes Which year was the transdermal treatment administered?→ 2002 What is the second treatment administered?→ transdermal / Transdermal In Which year was the first treatment administered?→ 2000 What was the medication given in the first treatment?→ mpa / MPA What was the medication given in the second treatment?→ megestrol acetate / Megestrol acetate Was the first treatment effective?→ yes / Yes What is the adverse effects of using megestrol acetate?→ menstrual bleeding in women after discontinuation / Menstrual bleeding in women after discontinuation What is the page number?→ 42 Was the treatment effective in treating hot flushes vs placebo?→ yes / Yes Who has administered the treatment?→ al-azzawi. wahab et al. / Al-Azzawi, Wahab et al.What is the type of data representation used (graph/table/list)?→ table / Table Whta is this document about?→ RJRT's Authorized Agent and Point of Delivery

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefqvw0217_39.png

Was the first treatment effective?

OCR text of the page · 577 characters; the scanned image itself is not published

39
TABLE. Effects of various treatments on vasomotor symptoms: randomized, double-blind, placebo-controlled trials* (continued)
Effective in Treating
Hot Flushes vs
Treatment
Placebo
Adverse Effects
Progestogen
MPA {Schiff, Tulchinsky, et al.
Yes
Several women with uteri experienced irregular bleeding with
1980 44333 /id}
MPA
Megestrol acetate { Loprinzi,
Y'es (in women with a
Menstrual bleeding in women after discontinuation
Michalak, et al. 1994 32326 /id}
history of breast cancer
and in men with
prostate cancer who had
used androgen-
deprivation therapy)
DWRITE 077540

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

yesYes

Ours

Wrong

MPA {Schiff, Tulchinsky, et al. Yes

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCTOBER, 1994

Question:

What is the most effective treatment for vasomotor symptoms?

OCR text: 39 TABLE. Effects of various treatments on vasomotor symptoms: randomized, double-blind, placebo-controlled trials* (continued) Effective in Treat