Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageyscw0217_12.png

What are the Number of Pages?

OCR text of the page · 692 characters; the scanned image itself is not published
DesignWrite
RATE
Important Fax Message
Please Deliver Immediately
To:
Giuseppe M.C. Rosano, MD, PhD,
Fax:
011-49-30-
FACC - GUEST
25021161
Palace Hotel Berlin
Date:
June 13, 2002
Time:
12:15 PM EST
From:
Adrienne Pitrelli for Karen
Phone:
609-924-1116
Mittleman, PhD
Fax:
609-497-2304
Number of pages (including cover sheet):
5
Re:
Article Requested by Karen Mittleman
Dear Dr. Rosano:
Karen Mittleman asked that we fax this article to your attention. Please let us
know if you have any questions. Thank you!
Sincerely.
Adrienne Pitrelli
189 WALL STREET, PRINCETON. NEW JERSEY 08540 . 609/924-1116 . FAX: 609/497-2304
Source: https://www.industrydocuments.ucsf.edu/docs/yscw0217
DWRITE 067823
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
5
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

5

1 characters2 tokens

Aux 2015

Exact match

5

1 characters2 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Input:

Question:

What is the number of pages in a document?

Question:

What is the number of pages in a document?

Question:

What is the number of pages in a document?

188 characters64 tokens