Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegmhp0000_2.png

What is the tagline given at the top?

OCR text of the page · 1,262 characters; the scanned image itself is not published
RJReynolds
Tobacco Company
"We Work for Smokers"
Rebecca Badgett - Distribution & Logistics
336-741-1781 (Telephone No.)
336-741-5334 (Fax No.)
7- 14- 98
Date)
......
TO ROU: 1210
VIA FAX (732) 417 - 9076
RE: Bill of Lading No.: 1838010 / ORDER# 818.10788
The carrier advises the above shipment has been refused for the following reayou:
Did not order
No room
Store closed
Do not want
No one there
Wrong items/(2ty.
Duplicate order
Order cancelled
Lother REFused - - Overshipped.
Please review and fax your recommendation as to the disposition of this shipment to my
attention no later than the suspense date shown at the bottom of this memoranduma so we
can provide the carrier with the proper written notification. If we do not receive your
faxed response by the suspense date, we will automatically advise the carrier to return the
shipment to the origin warehouse.
Please do not attempt to handle disposition directly with the carrier. This will allow us to
maintain our records of the refusal as well as all applicable charges It will alto ensure no
freight charges are billed to your office or to the customer.
Recommendation:
SUSPENSE DATE:
7- 16-98
0018 08IS
RJR IMP/EXPORT
6336 741 7569
12:39
Source: https://www.industrydocuments.ucsf.edu/docs/gmhp0000
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
"we work for smokers"
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

"We Work for Smokers"

21 characters7 tokens

Aux 2015

Wrong

RJ Reynolds Tobacco Company We Work for Smokers

Rebecca Badgett - Distribution & Logistics 336-741-1781 (Telephone No.) 336-741-5334 (Fax No.) 7- 14- 98

154 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Reynolds Tobacco Company

Question:

What is the tagline given at the top?

Reynolds Tobacco Company

Question:

What is the tagline given at the top?

Reynolds

168 characters64 tokens