Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehnhp0000_1.png

Who has sent the fax?

OCR text of the page · 808 characters; the scanned image itself is not published
RYReynolds
Tobacco Company
400 Raritan Center Parkway
Raritan Center
Edison, NJ 08837
108-225-4774 Fax 908-417-9076
Fax Message
TO:
MIKE WASHO / 1146
DATE:
6/6/96
SUBJECT: STATE MINIMUM FOR PRIVATE LABEL
TOTAL PIECES FAXED: 1
(INCLUDING COVER)
DEAR MIKE:
PER LANNY WOLFE -
FOLLOWING ARE FORMULAS FOR STATE MINIMUMS - PRIVATE LABEL
LIST PRICE PER 1,000 CIGARETTES X .98 (IS THE SAME AS DEDUCTING 2%)
ADD TAX PER 1,000 CIGARETTES (NJ IS $20 PER 1,000) THAT TOTAL X 1.06
DIVIDED BY 5 = STATE MINIMUM DELIVERED WHOLESALE PRICE.
LIST PRICE PER 1,000 CIGARETTES X .98 (IS THE SAME AS DEDUCTING 2%)
ADD TAX PER 1,000 CIGARETTES (NJ IS $20 PER 1,000) THAT TOTAL X 1.06 X 1.08
DIVIDED BY 5 = STATE MINIMUM DELIVERED RETAIL PRICE.
Fran
Fran Rhode
51840 6996
Source: https://www industrydocuments.ucsf.edu/docs/hnhp0000
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Fran RhodeFran
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Fran Rhode

10 characters3 tokens

Aux 2015

Wrong

The fax message is addressed to Mike Washo, with the sender's name as "Fran Rhode". The sender is the tobacco company, "Tobacco Company".

137 characters34 tokens

PiT-FT 2015

Wrong

Question: Who has sent the fax?

OCR text: RYReynolds Tobacco Company 400 Raritan Center Parkway Raritan Center Edison, NJ 08837 108-225-4774 Fax 908-417-9076

160 characters64 tokens

ChronoGPT 2015

Wrong

Tobacco Company

Tobacco Company 400 Raritan Center Edison, NJ 08837 108-225-4774 Fax 908-417-9076 Tobacco Company

Input:

Tobacco

137 characters64 tokens