Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqpwx0225_11.png

What is the Effective Date?

OCR text of the page · 363 characters; the scanned image itself is not published
Attachment 2
Effective Date 3- 28- 200 (
RJRT's Authorized Agent and Point of Delivery
1.
RJRT Authorized Agent:
HeldER's Burley Exchange
HOLDER'S BURLEY
EXCHANGE, L.L.C.
314 East Main Street
2.
Point of Delivery:
Hartsville, TN 37074
Grower:
Boy mal Pharr
RJRT Representative:
52381 9472
Page 10 of 12
Source: https://www.industrydocuments.ucsf.edu/docs/qpwx0225
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
3-28-2001
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.67

3- 28- 200 (

12 characters12 tokens

Aux 2015

Wrong

Effective Date: 3-28-200

24 characters13 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

RJRT Representative: Hartsville, TN 37074 Grower: Boy mal Pharr RJRT Authorized Agent: Holder's Burley Exchange HOLDER'S BURLEY EXCHANGE, L.L.C. 314 East Main Street 2.

168 characters64 tokens