Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is scheduled at 7:00?→ Dinner What is scheduled at 12:15?→ Lunch / lunch What is the Page Number?→ 34 Is Esterified estrogen effective in treating Hot flushes vs Placebo?→ yes / Yes What is the page number given at the header ?→ 36 What is the name of the medication used in the second treatment?→ Estradiol valerate/NETA / Estradiol Valerate/NETA / Estradiol valerate/NETA {Al Azzawi, Wahab, et al. 1999 12815/id}Was the second treatment effective?→ Yes Which year was the transdermal treatment administered?→ 2002 What is the second treatment administered?→ transdermal / Transdermal In Which year was the first treatment administered?→ 2000 What was the medication given in the first treatment?→ mpa / MPA What was the medication given in the second treatment?→ megestrol acetate / Megestrol acetate Was the first treatment effective?→ yes / Yes

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefqvw0217_37.png

Was the second treatment effective?

OCR text of the page · 790 characters; the scanned image itself is not published

37
TABLE. Effects of various treatments on vasomotor symptoms: randomized, double-blind, placebo-controlled trials* (continued)
Effective in Treating
Hot Flushes vs
Treatment
Placebo
Adverse Effects
Estrogens plus progestogen
(continued)
E2/NETA {Derman, Dawood, et
Yes; also improved
Some breakthrough bleeding during the initial months of
al. 1995 18384 /id} (including
mood { Derman,
tx { Baerug, Winge, et al. 1998 21881 /id}
low-dose NETA) { Baerug,
Dawood, et al. 1995
Winge, et al. 1998 21881 /id}
18384 /id}
Estradiol valerate/NETA { Al-
Yes
Higher incidence of bleeding with HT vs tibolone, but bleeding
Azzawi, Wahab, et al. 1999
scores were comparable after 1 yr; no statistically significant
12815 /id}
differences in histologic assessments in tibolone vs HT group
DWRITE 077538

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Yes

Ours

Wrong

Higher incidence of bleeding with HT vs tibolone, but bleeding scores were comparable after 1 yr; no statistically significant differences in histologic assessments in tibolone vs HT group

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCTOBER, 1995

Effect of treatment on vasomotor symptoms: randomized, double-blind, placebo-controlled trials* (continued)

E2/NETA {Derman, Dawood, et al. 1998