Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageymkp0227_4.png

What is the serial number of the second ticket?

OCR text of the page · 1,496 characters; the scanned image itself is not published
ORION LGA
CONJUNCTION TICATHIS
DESTINATION / G: A
2 GA CARRIER CALCINATION
8343:105:864
ME OF PASSENGER
NOT TRANSFERABLE
18343-105865
DR. WILLiAm DARBY
ISSUED IN LICHANGE FOR
BUOY SNA AA 123.09 HEIGHTS TRAVEL
SERVICE INC
FORKIKAL CARRIER FOAM & SERIAL NUMBER
ISSUE
PLACE
AGENTS RUmilic coup
BROOKLYN NY
SAM 24 217 09 33 68924 2 B
13
TICKET DESIGNATOR
GOOD FOX PASSAGE SITE IN POINTS OUTINTO
BNA JA 228.00
"LAGUARDIA
FARE BASIS ALLOW CARRIER FLIGHTICLASS CATE TIME STATUS A 42 3. 10)
NASHVILLE
AA 26:40
FUL TO PURCHASE O
DALLAS
AM OF FATMINT
AA 191 106 5 POR AGI-CK
ISSUING CARRIE
SAN DIEGO
PASSENGER TICKET & BAGGAGE CHECK - ISSUED BY
BAGGAGE
UNCHECKED
American Airlines
001 .1
39.81 4
ROUTE COD
SUR FON TO CONDITIONS OF CONTRACT ON PASSENGERS COUPON
51.19 1691.00
1
001
8343105864 6 0
NS (CARBON)
/ DESTINATION/ G A
126- CARRIER CALCULATION
8343:105 865
TRANSFERABLE
ISSUED IN EXCHANGE FOR
1018343- 105 86 4A COURSE BNA AM /23. Of HEIGHTS TRAVEL
SERVICE INC
De . William JARBy
BROOKLYN N Y
GINAL CARRIER FORM & SERIAL NUMBER
JAN AA 217.09 33 68924 2 B
ISSUE
BALA AA 228.04
X/0 6009 FOR PASSAGE BETWEEN POINTS OUTUINIE
O SAN DIEGO
FARE BASIS ALLOW CARRIER MIGHT/CLASS DATE TIME STATUS GAA 23.09
VP
DALLAS
IS UNLAWFUL TO PURCHASE ON RESILI THIS
TICKENG CARRIER OR ITS AUTHORIZED AGENTS
ONASHVILLE
14 95 A PASSENGER TICKET LABAGGAGE CHECK - ISSUED, BY
LAGUARDIA WORKED
American Airlines
co1 1
HOUSE CO
ASUBJECT TO CONDITIONS OF CONTRACT ON PASSENGERS COUPON
639.81
57.19 691.00
1
001
8343105865 0 0
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
8343105865
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

8343105865

10 characters11 tokens

Aux 2015

Wrong

The serial number of the second ticket is 8343105865.

57 characters21 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCR text: ORION LGA CONJUNCTION TICATHIS DESTINATION / G: A 2 GA CARRIER CALCINATION SUR FON TO CONDUCT SUR FON TO CONDUCT SUR FON TO COND

138 characters64 tokens