Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageymkp0227_13.png

What is the fare basis code for economy class?

OCR text of the page · 625 characters; the scanned image itself is not published
264 6 CARRIER CALCULATION
1207 265:954
HETGHT SURTRAVEL
NOT TRANSFERABLE
DR. William DARBY
ISSUED IN EXCHANGE FOR out
COUPON 2414 84 12309 SERVICE INC
1 GA An 123 20 BROOKLYN NY
ORIGINAL
CARRIER FORM & SERIAL NUMBER
33 68924 2 B
OR RESELL THIS
COUPONS HOY VALID AREA
ISSUE
THORIZED AGENTS
TICKET DESIGNATOR
8020 FOR PASSAGE BETWEEN
FARE BASIS ALLOW CARRIER FLIGHT/CLASS DATE TIN
DEC. 55
LAGUARDIA Y JA $171 21 7 APK
NASHVILLE
AA - 327 02 1 A KICK
TICKET FROMITO A
ISSUING CARRIER
LAGUARDIA
BAGGAGE
American Airlines(
UNCHECKED
001 1-
22218
FAIRSNEWEST TO CONDITIONS OF CONTRACT NUMBER
18:22 -246.00
1 :
001
1207265954 3 0
SOU
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Y
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

DEC. 55

7 characters6 tokens

Aux 2015

Wrong

264 6 CARRIER CALCULATION 1207 265:954 HETGHT SURTRAVEL NOT TRANSFERABLE DR. William DARBY ISSUED IN EXCHANGE FOR out COUPON 2414 84 1

134 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

1207 265954 3 0 SOU

19 characters10 tokens