Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageykmg0065_1.png

What is the location of the fax receiver ?

OCR text of the page · 1,090 characters; the scanned image itself is not published
R. J. REYNOLDS TOBACCO COMPANY FAX COVER SHEET
DATE
December 27. 1ave
PARUP TO
COMPANY
Arthur Loughlin
EDOATION
John Player & Gamin
Ireland
011-353-1-4546351
James E. Swauger
LOCATION
RJR Tobacco Co
950 Reynolds Blvy
DEPARTMENT NAME
Winston-salem
NO
aodontino & Pregulatory Affairs
TELEPHONE NUMBER
WAR NUMBER
NOMORE OF WAGES
(350) 741-0840
(338) 741-0815
WEBBAGE"
F. J. Reynolds sent this letter to the Irish Department of Health and Children on December 22. 1908.
TRANSMISSION REPORT
THIS DOCUMENT WAS CONFIRMED
( REDUCED SAMPLE ABOVE - SEE DETAILS BELOW)
** COUNT **
TOTAL PAGES SCANNED
TOTAL PAGES CONFIRMED
. .
Co CO
*** SEND ***
No
REMOTE STATION
START TIME
DURATION #PAGES
MODE
RESULTS
353 1 454 6351 12-22-98 5:30PM
0 '56"
3/
3 EC
COMPLETED
14400
NOTE :
TOTAL
0:00 '56"
3
PD
No. : OPERATION NUMBER
48
MB
: POLLED BY REMOTE
SEND TO MAILBOX
SF
4800BPS SELECTED
PG
STORE & FORWARD
EC : ERROR CORRECT
RI : RELAY INITIATE
G2
G2 COMMUNICATION
POLLING A REMOTE MP
: MULTI -POLLING
RS
RM
RELAY STATION
RECEIVE TO MEMORY
1665 ZI75
Source: https://www.industrydocuments,ucsf.edu/docs/ykmg0065
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
irelandIreland
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Winston-salem

13 characters5 tokens

Aux 2015

Wrong

RJR Tobacco Company Fax Cover Sheet December 27. 1908 PARUP TO COMPANY Arthur Loughlin EDOATION John Player & Gamin Ireland 011-353-1-4546351 James E.

150 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

R. J. Reynolds Tobacco Company

DATE December 27, 1908

LOCATION RJR Tobacco Company

LOCATION RRI TOBACCO COMPANY DATE

Input:

Question:

What is the location of

171 characters64 tokens