Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyhxd0227_3.png

what is the invoice number?

OCR text of the page · 766 characters; the scanned image itself is not published
Cardmember Acct. No.
Card No.
094 801 018 6 100A)
Cardmember
VALID 04 75
THRU 03 76
AMERICAN
Approval Code
EXPRESS
ROBERT E SHANK M D
CARDS
Check or Bill No.
2 12
Service Establishment
Any delayed charges
WA
WHEEL
are entered below:
ROCKTON ILL
Merchandise/Services
Type of Delayed Chg.
3120510664
10 15 75
Taxes
Amt. of Delayed Chg.
Establishment gerses to transmit to American Express for payment.
Merchandise and/or service purchased on this card shall not be resold or
Tips/Misc.
Revised Total
eturned for cash refund.
Cardmember Signature
Total
Amer, Expr Use Only
Equivalent Amt.
ROC FORM 20249-REV. 10-72 PRINTED IN USA 10-72
Invoice Number
American
Record of
Express
Charges
87950b
Cardmember
Copy
Source: https://www.industrydocuments.ucsf.edu/docs/yhxd0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
879506
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.83

87950b

6 characters7 tokens

Aux 2015

Wrong

The invoice number is:

22 characters6 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Cardmember Card No. 094 801 018 6 100A) Card No.

Question:

What is the card number of the cardholder?

Card No. 094 801 018 6 100A) Card No.

151 characters64 tokens