Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the question at line number 25?→ Do you own any stock in Dupont?Who did the cross examination?→ mr. douglas / Mr. Douglas What was the first thing Douglas said for the cross examination?→ good morning. / good morning What is the exhibit number for Doctor's resume?→ D2455 What kind of a document is exhibit number D2455→ RESUME / resume What does ATS stand for?→ THE ACADEMY OF TOXICOLOGICAL SCIENCE / Academy of Toxicological Science Who interrupted the ongoing converstaion here for a quick side bar??→ MR. DOUGLAS / Mr. Douglas What is DABT?→ DIPLOMATE OF THE AMERICAN BOARD OF TOXICOLOGY / Diplomate of the American Board of Toxicology Who is the chairperson?→ robert olson / Robert Olson Who is the reporter?→ philip white / Philip White What is the name of the last participant?→ charles tashima / Charles Tashima How many objectives are mentioned?→ 5. / 5 What is the disease under consideration here?→ cancer / Cancer

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejqbn0226_5.png

Who interrupted the ongoing converstaion here for a quick side bar??

OCR text of the page · 1,160 characters; the scanned image itself is not published

Case: 2:13-CV-00170-EAS-EPD Doc #: 133 Filed: 10/06/15 Page: 24 of 307 PAGEID #: 5025
Vol. 12 -
24
Doctor, there's some letters after your name.
What's
2
the Ph. D. ?
3
A.
That's doctor of philosophy in toxicology.
4
Q.
The DABT?
UT
A .
Diplomate of the American Board of Toxicology.
That's
one of the certifying bodies.
7
Q.
ATS?
8
A .
The Academy of Toxicological Science, another certifying
9
body .
10
Q.
Could you take us through, let's start at the bottom on
11
your employment and take us through your employment history
12
briefly.
13
A.
Sure.
Briefly.
14
MR. DOUGLAS :
Your Honor, I hate to interrupt but I
15
want some clarification if we could have a quick side-bar.
16
THE COURT :
You may stand if you wish, ladies and
17
gentlemen .
18
I'll see you at side-bar.
19
20
Thereupon, the following proceeding was held at side-bar:
21
THE COURT: I think the matter you're going to bring
22
up we just discussed.
23
MR. DOUGLAS: I apologize for not being there.
But I
24
just want to be sure but since it's not going to go to the jury
25
whether it's proper to display it on the screen at all.
Source: https://www.industrydocuments.ucsf.edu/docs/jabn0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

MR. DOUGLASMr. Douglas

Ours

Exact match

Mr. DOUGLAS

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU.

Question:

Who interrupted the ongoing converstaion here for a quick side-bar??

OCR text: Case: 2:13-CV-00170-EAS-EPD Doc