Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejqbn0226_34.png

What was the first thing Douglas said for the cross examination?

OCR text of the page · 990 characters; the scanned image itself is not published
Case: 2:13-CV-00170-EAS-EPD Doc #: 133 Filed: 10/06/15 Page: 53 of 307 PAGEID #: 5054
Vol. 12 -
53
A .
No .
2
O .
Did you receive a subpoena to be here to testify today?
A
Yes, I did.
4
Q.
Was that served on your at your office at the University
5
of Cincinnati?
A .
Yes, it was.
7
Q .
Other than reimbursement of your mileage expenses for
traveling here to testify and your daily subpoena attendance
9
fee of $40 are you receiving any money from DuPont?
10
A .
From Dupont, no.
11
Did I talk to you by phone to check on some facts a
12
couple of times over the past few months?
13
A.
Yes, you did.
14
Q .
Did you ever meet me before you walked into the
15
courtroom today?
16
A.
No, I haven't.
17
MR. MACE :
Thank you, sir.
I have nothing further at
18
this time.
19
THE COURT:
Thank you, Mr. Mace.
20
Mr. Douglas, you may cross-examine.
21
22
CROSS-EXAMINATION
23
BY MR. DOUGLAS :
24
Good morning.
25
A .
Top of the day to you.
Source: https://www.industrydocuments.ucsf.edu/docs/jabn0226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
good morning.good morning
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Good morning.

13 characters4 tokens

Aux 2015

Wrong

Good morning.

Top of the day to you.

37 characters12 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCR text: Case: 2:13-CV-00170-EAS-EPD Doc #: 133 Filed: 10/06/15 Page: 53 of 307 PAGEID #: 5054 Vol. 12 - O. Did you receive a subpoena to be here to testify today

163 characters64 tokens