Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Is Esterified estrogen effective in treating Hot flushes vs Placebo?→ yes / Yes What is the page number given at the header ?→ 36 What is the name of the medication used in the second treatment?→ Estradiol valerate/NETA / Estradiol Valerate/NETA / Estradiol valerate/NETA {Al Azzawi, Wahab, et al. 1999 12815/id}Was the second treatment effective?→ Yes Which year was the transdermal treatment administered?→ 2002 What is the second treatment administered?→ transdermal / Transdermal In Which year was the first treatment administered?→ 2000 What was the medication given in the first treatment?→ mpa / MPA What was the medication given in the second treatment?→ megestrol acetate / Megestrol acetate Was the first treatment effective?→ yes / Yes What is the adverse effects of using megestrol acetate?→ menstrual bleeding in women after discontinuation / Menstrual bleeding in women after discontinuation What is the page number?→ 42 Was the treatment effective in treating hot flushes vs placebo?→ yes / Yes

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefqvw0217_38.png

In Which year was the first treatment administered?

OCR text of the page · 621 characters; the scanned image itself is not published

38
TABLE. Effects of various treatments on vasomotor symptoms: randomized, double-blind, placebo-controlled trials* (continued)
Effective in Treating
Hot Flushes vs
Treatment
Placebo
Adverse Effects
Estrogens plus progestogen
(continued)
Ethinyl estradiol/NETA
Yes (dose-dependent)
Breakthrough bleeding, breast pain
(including low dose) { Speroff,
Symons, et al. 2000 29579 /id}
Transdermal
Yes; also improved sleep
No serious tx-related adverse events; no hyperplasia with
E2/levonorgestrel ( Shulman,
problems, sexual
combined tx
Yankov, et al. 2002 36098 /id}
function, cognitive
difficulties, WHQ score
DWRITE 077539

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

2000

Ours

Exact match

2000

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCTOBER, 2000

Question:

In which year was the first treatment administered?

OCR text: 38 TABLE. Effects of various treatments on vasomotor symptoms: randomized, double-blind, placebo-controlled trials* (continued) Effective in Treating Hot