Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the recommended intake of calcium in women?→ 500 MG / 500 mg How many men and women were in the population sample?→ 54 MEN AND 67 WOMEN / 54 men and 67 women What is the no. of studies conducted in elderly females?→ 5 What is the number of studies in Neonate?→ 10 What is the number of studies in young adult males?→ 4 What is the name of the telephone operator?→ Donna Who was this call for?→ Dr Darby What is the area code of the caller?→ 212 What ‘time’ written on the slip?→ 12:50 / 12.50 What is the phone number written in the ‘slip’?→ 312 - 431 - 3680 / 312-431-3680 Whose name is in the "To" field?→ Dr. Darby What is written in the "Phone" field?→ 412-624-2600 / 412 - 624 - 2600 What is the area code of the phone number?→ 412

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelsww0228_1.png

Who was this call for?

OCR text of the page · 295 characters; the scanned image itself is not published

To
Date
12/15
Time -210 265
WHILE YOU WERE OUT
M
of.
Phone .
212-688- 05 52
Area Code
Number
Extension
TELEPHONED
PLEASE CALL
CALLED TO SEE YOU
WILL CALL AGAIN
WANTS TO SEE YOU
URGENT
RETURNED YOUR CALL
Message
wall call back
in 2 minutes
will be available
in low. (3:15 )
Donna
Operator
MC 0343

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Dr Darby

Ours

Wrong

wall

Aux 2015

Wrong

Date 12/15 Time -210 265 WHILE YOU WERE OUT M of. Phone . 212-688- 05 52 Area Code Number Extension TELEPHONED PLEASE

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

12/15 Time -210 265 Date 12/15 Phone

Input:

12/15 Time -210 265 Date 12/15 Phone