Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagejycf0227_1.png

In which service was the least number of patients discharged?

OCR text of the page · 1,396 characters; the scanned image itself is not published
BARNES HOSPITAL
Page 1 of 3
1410-32
ANALYSIS OF HOSPITAL SERVICE
Rev. 5/76
MONTH_6 Months 1978
NO. OF
DEATHS
AUTOPSIES
SERVICE
PATIENTS
DAYS CARE
AVERAGE
DISCHARGED
DISCHARGED
DAYS
NO.
%
NO.
PATIENTS
STAY
MEDICINE
3,510
5 *
2
224
6.4
94
42.
39, 785
2*
11 . 3
NEUROLOGY
884
20
3.3
11
37.9
10, 977
12. 4
PSYCHIATRY
682
O
0.0
15, 443
22.6
RADIOLOGY
0
0.0
44
6.3
UNCOVERED MED.
7d
1, 446
30
2. 1
7
23.3
13, 043
9.0
GENERAL SURGERY
2, 111
65
3.1
11
16. 9
3 *
22, 838
10.8
CARDIOTHORACIC
610
35
5.7
8
22.9
7, 232
11. 9
ORTHOPEDIC
2*
1, 096
0.5
O
0.0
13, 223
12. 1
UROLOGY
821
2
0. 2
50. 0
6,473
7.9
NEUROSURGERY
367
17
4 . 6
3
17.6
5,574
15.2
PLASTIC
4 *
579
5
0. 9
0
0.0
3,187
5.5
ORAL SURGERY
197
0
0. 0
815
4 . 3
OB. - DELIVERED
1, 870
0.0
9,496
5. 1
UNDELIVERED
239
O
0.0
1, 009
4. 2
GYNECOLOGY
1, 902
12
0. 6
2
16.7
11, 477
6.0
ABORTED
16
0
0. 0
53
3.3
OTOLARYNGOLOGY
1, 501
9
0. 6
1
11.1
8, 684
5.8
OPHTHALMOLOGY
1, 872
1
0.1
0
0.0
9,570
5.1
NEWBORN
1, 842
0.4
4
57.1
9 , 668
21,546
28*
5. 2
TOTAL ACUTE CARE
2. 0
142 @
35.1
188 , 591
8.8
SELF CARE
29
0.0
2, 219
7.4
GRAND. TOTAL
21, 845
28* 11@
441
2. 0
142
32. 2
190, 870
8 . 7
LESS N.B.
34.4
TOTAL MEDICARE ACUTE
5 , 423
252
4.6
77
30.6
64,299 11.9
TOTAL MEDICARE S.C.
53
0.0
395
7.5
GRAND TOTAL MEDICARE
5, 476
252
4.6
77
30. 6
64, 694
1 1.8
* = Coroner's Case
= Anatomical Release
Source: https://www.industrydocuments.ucsf.edu/docs/jycf0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Radiology
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

UNDELIVERED

11 characters5 tokens

Aux 2015

Wrong

We are given a single document page with a question and a list of data. The question is: "In which service was the least number of patients discharged?"

We are to return only the answer, with no explanation.

Looking at the data, we see that the least number of patients discharged is **14

290 characters64 tokens

PiT-FT 2015

Wrong

<|_sistant|> <|_sistant|> <|_sistant|> <|_sistant|> <|_sistant|> <|_sistant|> <|_sistant|> <|_sistant|>

104 characters64 tokens

ChronoGPT 2015

Wrong

ChronoGPT Page 1 of 3 1410-32 ANALYSIS OF HOSPITAL SERVICE Rev. 5/76 MONTH_6 MONTHS 1978 NO. OF DEATHS AUTOPSIES SERVICE PATIENTS DAY DIS

137 characters64 tokens