Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageymkp0227_4.png

What is the name of the passenger?

OCR text of the page · 1,496 characters; the scanned image itself is not published
ORION LGA
CONJUNCTION TICATHIS
DESTINATION / G: A
2 GA CARRIER CALCINATION
8343:105:864
ME OF PASSENGER
NOT TRANSFERABLE
18343-105865
DR. WILLiAm DARBY
ISSUED IN LICHANGE FOR
BUOY SNA AA 123.09 HEIGHTS TRAVEL
SERVICE INC
FORKIKAL CARRIER FOAM & SERIAL NUMBER
ISSUE
PLACE
AGENTS RUmilic coup
BROOKLYN NY
SAM 24 217 09 33 68924 2 B
13
TICKET DESIGNATOR
GOOD FOX PASSAGE SITE IN POINTS OUTINTO
BNA JA 228.00
"LAGUARDIA
FARE BASIS ALLOW CARRIER FLIGHTICLASS CATE TIME STATUS A 42 3. 10)
NASHVILLE
AA 26:40
FUL TO PURCHASE O
DALLAS
AM OF FATMINT
AA 191 106 5 POR AGI-CK
ISSUING CARRIE
SAN DIEGO
PASSENGER TICKET & BAGGAGE CHECK - ISSUED BY
BAGGAGE
UNCHECKED
American Airlines
001 .1
39.81 4
ROUTE COD
SUR FON TO CONDITIONS OF CONTRACT ON PASSENGERS COUPON
51.19 1691.00
1
001
8343105864 6 0
NS (CARBON)
/ DESTINATION/ G A
126- CARRIER CALCULATION
8343:105 865
TRANSFERABLE
ISSUED IN EXCHANGE FOR
1018343- 105 86 4A COURSE BNA AM /23. Of HEIGHTS TRAVEL
SERVICE INC
De . William JARBy
BROOKLYN N Y
GINAL CARRIER FORM & SERIAL NUMBER
JAN AA 217.09 33 68924 2 B
ISSUE
BALA AA 228.04
X/0 6009 FOR PASSAGE BETWEEN POINTS OUTUINIE
O SAN DIEGO
FARE BASIS ALLOW CARRIER MIGHT/CLASS DATE TIME STATUS GAA 23.09
VP
DALLAS
IS UNLAWFUL TO PURCHASE ON RESILI THIS
TICKENG CARRIER OR ITS AUTHORIZED AGENTS
ONASHVILLE
14 95 A PASSENGER TICKET LABAGGAGE CHECK - ISSUED, BY
LAGUARDIA WORKED
American Airlines
co1 1
HOUSE CO
ASUBJECT TO CONDITIONS OF CONTRACT ON PASSENGERS COUPON
639.81
57.19 691.00
1
001
8343105865 0 0
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Dr. William Darby
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

DR. WILLiAm DARBY

17 characters8 tokens

Aux 2015

Wrong

The question asks for the name of the passenger.

Looking at the OCR text, I see:

  • "ORION LGA"
  • "CONJUNCTION TICATHIS"
  • "DESTINATION / G: A"
  • "2 GA CARRIER CALCULATION"
  • "834
180 characters64 tokens

PiT-FT 2015

Wrong

Question: What is the name of the passenger?

OCR text: ORION LGA CONJUNCTION TICATHIS DESTINATION / G: A 2 GA CARRIER CALCINATION 8343-105 865 ME OF PASSENG

158 characters64 tokens

ChronoGPT 2015

Wrong

OCR text: ORION LGA CONJUNCTION TICATHIS DESTINATION / G: A 2 GA CARRIER CALCINATION SUR FON TO CONDUCT SUR FON TO CONDUCT SUR FON TO COND

138 characters64 tokens