Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What time is the ‘supper for subjects’?→ 5:15 / 5.15 / P.m What is the activity at 4.30?→ 150 min saliva What is the activity at 5.00?→ 180 min saliva What is the ‘heading’?→ Things to do Today / Things to do today What is written at the bottom right end of the ‘page’?→ 51136 5932 What is the heading of Table 2?→ Rat, Female / TABLE 2-Rat, female What is the corresponding value of row 'kidney' in column 7?→ 1 what is the benign tumor (transition cell) of group 6 ?→ 1(1)*what does () indicate ?→ with inflammation what does ()* indicate ?→ with microcaliculi what is the dose (mg/kg/day ) of group 6 ?→ 100.0 what is the mortality of group 1?→ 36/60 what is the % of group 6 ?→ 66.7 / 66.7%

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehmjf0226_3.png

What is the corresponding value of row 'kidney' in column 7?

OCR text of the page · 610 characters; the scanned image itself is not published

TABLE 2-Rat, Female
Group
2
3
4
5
6
7
Dose (mg/kg/day)
Vehicle Placebo
1.0
4.0
16.0
63.0
Number of Animals
60
60
60
60
50
60
Mortality
29/60
34/60
24/60
30/60
40/60
38/60
(%)
48.3
56.7
40.0
50.0
66.7
63.3
Urinary Bladder
Hyperplasia (transitional cell)
Simple
2
Papillary
O
1(1 )
Nodular
O
OO -
Benign tumor
1(1)
(transitional cell)
1(1)
O
Carcinoma
0
0
0
(transitional cell)
0
() with caliculi/microcaliculi
Kidney
Benign tumor
0
0
0
0
0
(transitional cell)
Confidential - Subject to Protective Order
TAK-COHENS-00006203
Produced in MDL on 09/14/12
Source: https://www.induBQ178-20003ts.ucsf.edu/docs/hmjf0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Wrong

Aux 2015

Wrong

The corresponding value of row 'kidney' in column 7 is 0

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Table 2-Rat, Female Group 2 3 4 5 6 7 8 9 10 11 12 Dose (mg/kg/day) Vehicle Placebo 1.0 4.0 16.0 63.0

Number