Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the no. of studies conducted in elderly females?→ 5 What is the number of studies in Neonate?→ 10 What is the number of studies in young adult males?→ 4 What is the name of the telephone operator?→ Donna Who was this call for?→ Dr Darby What is the area code of the caller?→ 212 What ‘time’ written on the slip?→ 12:50 / 12.50 What is the phone number written in the ‘slip’?→ 312 - 431 - 3680 / 312-431-3680 Whose name is in the "To" field?→ Dr. Darby What is written in the "Phone" field?→ 412-624-2600 / 412 - 624 - 2600 What is the area code of the phone number?→ 412 At what time was the call recieved?→ 950 / 9 50 What is the ‘heading’?→ economic growth / Economic growth

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelsww0228_11.png

What ‘time’ written on the slip?

OCR text of the page · 233 characters; the scanned image itself is not published

To
D Dailey
Date.
Time 2150
WHILE YOU WERE OUT
M
Sode
of
Phone
Area Code
3/ 2 - 43 1 - 3680
Number
Extension
TELEPHONED
PLEASE CALL
CALLED TO SEE YOU
WILL CALL AGAIN
WANTS TO SEE YOU
URGENT
RETURNED YOUR CALL
Message
Operator
MC 0343

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

12:5012.50

Ours

Partial · ANLS 0.60

2150

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Time 2150

Question:

What time is it when you are in the morning?

Time 2150

Question:

What time is it when you are in the evening?

Time 2150

Question:

What time is