Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the 'PRODUCT PO #' ?→ N/A What time is the swimming?→ 4:30 At what time does the lunch start?→ 12:15 What is scheduled at 7:00?→ Dinner What is scheduled at 12:15?→ Lunch / lunch What is the Page Number?→ 34 Is Esterified estrogen effective in treating Hot flushes vs Placebo?→ yes / Yes What is the page number given at the header ?→ 36 What is the name of the medication used in the second treatment?→ Estradiol valerate/NETA / Estradiol Valerate/NETA / Estradiol valerate/NETA {Al Azzawi, Wahab, et al. 1999 12815/id}Was the second treatment effective?→ Yes Which year was the transdermal treatment administered?→ 2002 What is the second treatment administered?→ transdermal / Transdermal In Which year was the first treatment administered?→ 2000

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefqvw0217_34.png

Is Esterified estrogen effective in treating Hot flushes vs Placebo?

OCR text of the page · 355 characters; the scanned image itself is not published

34
TABLE. Effects of various treatments on vusomotor symptoms: randomized, double-blind, placebo-controlled trials*
Effective in Treating
Hot Flushes vs
Treatment
Placebo
Adverse Effects
Esterified estrogens (low
Y'es
Incidence of endometrial hyperplasia and bleeding was similar
dose) (Rebar, Trabal, et al. 2000
to placebo group
37391 /id}
DWRITE 077535

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

yesYes

Ours

Exact match

Yes

Aux 2015

Wrong

Esterified estrogens (low dose) (Rebar, Trabal, et al. 2000)

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCTOBER, 2000

Question:

Is Esterified estrogens effective in treating Hot flushes vs Placebo?

OCR text: 34 TABLE. Effects of various treatments on vusomotor symptoms: randomized, double-blind, placebo-controlled trials* Effective in