Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyscw0217_12.png

Who is this Fax from?

OCR text of the page · 692 characters; the scanned image itself is not published
DesignWrite
RATE
Important Fax Message
Please Deliver Immediately
To:
Giuseppe M.C. Rosano, MD, PhD,
Fax:
011-49-30-
FACC - GUEST
25021161
Palace Hotel Berlin
Date:
June 13, 2002
Time:
12:15 PM EST
From:
Adrienne Pitrelli for Karen
Phone:
609-924-1116
Mittleman, PhD
Fax:
609-497-2304
Number of pages (including cover sheet):
5
Re:
Article Requested by Karen Mittleman
Dear Dr. Rosano:
Karen Mittleman asked that we fax this article to your attention. Please let us
know if you have any questions. Thank you!
Sincerely.
Adrienne Pitrelli
189 WALL STREET, PRINCETON. NEW JERSEY 08540 . 609/924-1116 . FAX: 609/497-2304
Source: https://www.industrydocuments.ucsf.edu/docs/yscw0217
DWRITE 067823
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Adrienne Pitrelli for Karen Mittleman, PhDAdrienne Pitrelli for Karen Mittleman, PhD.
Models
4 of 4 columns · click a model to add or remove it

Ours

Partial · ANLS 0.69

Adrienne Pitrelli for Karen Pitrelli for Karen Mittleman, PhD

61 characters19 tokens

Aux 2015

Wrong

To: Giuseppe M.C. Rosano, MD, PhD, Fax: 011-49-30- FACC - GUEST 25021161 Palace Hotel Berlin Date: June 13, 2002 Time:

118 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Input:

Question:

Who is this Fax from?

OCR text: DesignWrite RATE Important Fax Message Please deliver immediately To: Giuseppe M.C. Rosano, PhD, Phone: 609-49-30-

173 characters64 tokens