Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefmkp0227_5.png

What is the taxt amount?

OCR text of the page · 662 characters; the scanned image itself is not published
CONJUNCTION TICKETIST
DESTINATZ OF
CARRIER CALCULATION
See below for Airline
NOT TRANSFERABLE
ISSUED IN EXCHANGE FOR
24 MAR807
PASSENGER'S
Form, Serial Number
NAME OF
HEIGHTS TRAVEL
DR. WILLIAM JARBy
SERVICE INC
PLACE
ENTS NUMERIC CO
BROOKLYN N Y
12 - 13 4 PESSIM
33 68924 2 B
12 NOT GOOD FOR PASSAGE 4
TICKET DESIGNA
LA GUARDIA
FARE BASIS ALLOW CARRIER FLIGHT/ CLASS
DETROIT
A4 337M
HONGSAGE
SAGINAW
IT IS UNLAWFUL TO PURCHASE OR RE
CLEVELANDX
2133 YET- CK
A 326 2
PASSENGER TICKET & BAGGAGE CHECK - ISSUED BY
LAGUARDIA
BAGGAGE
American Airlines
UNCHECKED
001 1
200,00
TOUTE COL
AT SUEVECT TO CONDITIONS OF CONTRACT O
RS COUPON
:16.00 1216.20
001
1403465516 5 0
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
16.00
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

:16.00 1216.20

14 characters15 tokens

Aux 2015

Wrong

CONJUNCTION TICKETIST DESTINATZ OF CARRIER CALCULATION See below for Airline NOT TRANSFERABLE ISSUED IN EXCHANGE FOR 24 MAR807 PASSENGER'S Form, Serial Number NAME OF HEIGHTS TRAVEL DR

184 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET TICKET T

127 characters64 tokens