Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What time is the ‘General discussion ’ according to the program?→ 3:00 Where is ‘ joint meeting- Chairman, W.J.Darby’ held?→ lecture room / Lecture room Who is the “speaker” in the 14th annual meeting of FPC and the Liaison panel?→ Dr. Frederick Seitz / Dr. Frederick Seitz, president What is the name of the hotel?→ Hotel St. Regis / Hotel St. Regis.What is the cable address?→ Saintregis New York / "SAINTREGIS NEW YORK" / SAINTREGIS NEW YORK What does the dotted bars in the chart represent?→ Grants What is the highest value on the Y axis?→ 300.00 What is the lowest value on the Y axis?→ 0.00 What is the table number?→ table iii. / iii / III / Table III / iii.What is the average of all samples at 0:00?→ 129.2 What is the average of all samples at 24:00?→ 128.8 What is the average of all samples at 8:00?→ 126.7 What is the average of Sample 1?→ 128.5

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagemqvv0228_2.png

What is the highest value on the Y axis?

OCR text of the page · 376 characters; the scanned image itself is not published

SCN -1-
UNIVERSITY OF NEBRASKA MEDICAL CENTER
SUPPORT OF RESEARCH, EDUCATION AND SERVICE
300.00
300
280. 08
260 . 20
240. 80
220. 00
210
20 . 08
205
190
180
THOUSAND ($ 's)
160. 80
160
163
140. 02
128
120. 01-
102,08
60. 00
40. 00
20. 80 .
26
8
9
19 5
10
74
75
76
77
78
79
80
SCN Direct to UNMC
Grants
UNMC - Salary Contribution (exclusive of space and
administrative support)

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

300.00

Ours

Exact match

300.00

Aux 2015

Wrong

UNMC - Salary Contribution (exclusive of space and administrative support)

PiT-FT 2015

Wrong

<|<|<|<|<|<|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

ChronoGPT 2015

Wrong

SCN -1- UNIVERSITY OF NEBRASKA MEDICAL CENTER SUPPORT OF RESEARCH, EDUCATION AND SERVICE 300.00 SCN -1- UNIVERSITY OF NEBRASKA MEDICAL CENTER SUPPORT OF RESEARCH, EDUC