Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelnwg0227_29.png

What is the 'Type', printed at the bottom?

OCR text of the page · 1,055 characters; the scanned image itself is not published
SH147, 648
MEMORANDUM OF U. S. GOVERNMENT
REQUEST FOR TRANSPORTATION
SH147, 648
STATEMENT OF TRAVEL
FEDERAL SECURITY AGENCY
THE
Public Health Service
Washington, D. C.
Agent's
Valuation
$
MODE OF
THIS STUB IS FOR TRAVELER'S USE
(Department and Bureau or Service)
(City )
of ticket
TRAVEL
Has requested
Company to furnish transportation
(show abbreviated
name of carrier and
For use of
and
at the lowest fare
class of service used)
From
Trans-
Seat or Sleeper Accommodations
Agent's
portation Standard
Tourist
Valuation
of ticket
$
To
Route:
FROM
(Show classes of service between junctions on mixed travel)
Class
Number of
Persons
Upper
Lower
Upper
Lower
3 Tier Bed
Seats
Troop Sleeper
Lbs. of Excess
Baggage
TIME OF
DEPARTURE
DATE
Appropriation
Authorization
or object
TO
TIME OF
19
This memorandum should be
ARRIVAL
DATE
Place of Issue
forwarded in accordance with
administrative instructions.
REMARKS
TICKET AGENTS WILL NOT ACCEPT THIS
Type A
A LEGIBLE CARBON MUST ALWAYS BE SECURED
IMPORTANT
Source: https://www.industrydocuments.ucsf.edu/docs/Inwg0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Type A
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Type A

6 characters3 tokens

Aux 2015

Exact match

Type A

6 characters3 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Type A

Question:

What is the 'Type', printed at the bottom?

Type A

Question:

What is the 'Type', printed at the bottom?

Type A

Question:

What is the 'Type',

175 characters64 tokens