Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the highest number of responses for Question 10, for any given % of inside sales?→ 17 How many people did not answer question 11?→ 8 How many people have a percentage of Total sales between 11 to 16%?→ 10 How many organisations are currently in the carton sales business as well as pack?→ 27 What was the question# of the question unanswered by maximum number of people?→ 14 Which checkbox is checked?→ FOR YOUR INFORMATION Who is this slip from?→ Chris What is the title of the ‘form’?→ Water Analysis / Water analysis What is the name of factory?→ Gering / Gering factory What ‘kind of water’ is given for analysis ?→ Boiler feed What is the ‘pH’?→ 7.5 What is the date on the ‘form’?→ May 4, 1960 What is the x axis of the plot?→ EXPERIMENT NUMBER / Experiment number

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefzkc0228_1.png

Who is this slip from?

OCR text of the page · 461 characters; the scanned image itself is not published

NOTE.-DO NOT USE THIS ROUTE SLIP TO
SHOW FORMAL CLEARANCES OR APPROVALS
DATE
10 June 64
TO:
AGENCY
BLDG. ROOM
APPROVAL
REVIEW
OPER CONVERSATION
SIGNATURE
NOTE AND SEE ME
AS REQUESTED
COMMENT
NOTE AND RETURN
NECESSARY ACTION
FOR YOUR INFORMATION
[] PREPARE REPLY FOR SIGNATURE OF
REMARKS:
(Fold here for return)
To
- - - -
From
PHONE
BUILDING
ROOM
FORM HEW-30 REV. 11/56
ROUTE SLIP
GPO : 1956-0-409606
Source: https://www.industrydocuments.ucsf.edu/docs/fzkc0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Chris

Ours

Wrong

Cannot answer the question as the "From" field is not visible in the provided OCR text.

Aux 2015

Wrong

To: Agency BLDG. ROOM APPROVAL REVIEW OPER CONVERSATION SIGNATURE NOTE AND SEE ME AS REQUESTED COMMENT NOTE AND RETURN NECESSARY ACTION FOR YOUR INFORMATION [] PREPARE REPLY FOR SIGNATURE OF REMARKS:

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

[1] [2] [3] [4] [5] [6] [7] [8] [9] [10] [11] [12] [13] [14] [15] [16] [17] [18] [19] [20] [21] [