Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the number of studies in young adult males?→ 4 What is the name of the telephone operator?→ Donna Who was this call for?→ Dr Darby What is the area code of the caller?→ 212 What ‘time’ written on the slip?→ 12:50 / 12.50 What is the phone number written in the ‘slip’?→ 312 - 431 - 3680 / 312-431-3680 Whose name is in the "To" field?→ Dr. Darby What is written in the "Phone" field?→ 412-624-2600 / 412 - 624 - 2600 What is the area code of the phone number?→ 412 At what time was the call recieved?→ 950 / 9 50 What is the ‘heading’?→ economic growth / Economic growth What kind of document is this?→ 2001 KBA CONTRACT FORMATION What is the Venue name mentioned in this document?→ 735 Night Club

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelsww0228_2.png

Whose name is in the "To" field?

OCR text of the page · 257 characters; the scanned image itself is not published

To
D. Party
Date _ 2- 15 - 8 2 Time 12:220
WHILE YOU WERE OUT
M
of
2 Stark Office
Phone
412 - 6024 - 2650
Area Code
Number
Extension
TELEPHONED
PLEASE CALL
CALLED TO SEE YOU
WILL CALL AGAIN
WANTS TO SEE YOU
URGENT
RETURNED YOUR CALL
Message
Operator
MC 0343

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Dr. Darby

Ours

Partial · ANLS 0.67

D. Party

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

To D. Party Date _ 2- 15 - 8 2 Time 12:220 WHILE YOU WERE OUT M of 2 Stark Office Phone 412 - 6024 - 2650 Area Number Extension TELEPHONED PLEASE CALL CALLED