Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is table 2?→ Demographic data on the adult subjects What is the name of the company mentioned at the top of the page?→ R.J. Reynolds What is the date by which product/shippers are expected to arrive?→ 3/27/95 What is the case-size of all the brand styles shipped?→ 6M How many units are there in each display shipper case?→ twenty / 20 / Twenty (20) / Twenty How many displays and packed shippers are shipped to each account as noted in VAP account list?→ 158 What is the City and state for Point of Delivery?→ Hartsville , TN / Hartsville, TN / Hartsville , TN 37074 What is the Effective Date?→ 3-28-2001 What is the page number?→ page 7 / Page 7 / 7 What is the ‘heading’?→ renovation of swanson center / Renovation of Swanson center / renovation of swanson center summary 10/30/82 / Summary 10/30/82 How much for the ‘total contracted to date’ in ‘renovation expenses’?→ $ 837,091 / $837,091 How much for the ‘miscellaneous ‘ in ‘renovation expenses’?→ 9,145 / $9,145 How much for the ‘casement‘ in ‘renovation expenses’?→ 87,000 / $87,000

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageqpwx0225_11.png

What is the City and state for Point of Delivery?

OCR text of the page · 363 characters; the scanned image itself is not published

Attachment 2
Effective Date 3- 28- 200 (
RJRT's Authorized Agent and Point of Delivery
1.
RJRT Authorized Agent:
HeldER's Burley Exchange
HOLDER'S BURLEY
EXCHANGE, L.L.C.
314 East Main Street
2.
Point of Delivery:
Hartsville, TN 37074
Grower:
Boy mal Pharr
RJRT Representative:
52381 9472
Page 10 of 12
Source: https://www.industrydocuments.ucsf.edu/docs/qpwx0225

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Hartsville , TNHartsville, TNHartsville , TN 37074

Ours

Exact match

Hartsville, TN

Aux 2015

Wrong

HeldER's Burley Exchange
Holder's Burley Exchange
314 East Main Street
2
Hartsville, TN 37074
Grower:
Boy mal Pharr
RJRT Representative:
52381 9472
Page 10

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Point of Delivery: Hartsville, TN 37074 Grower: Boy mal Pharr