Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

what is the dose (mg/kg/day ) of group 6 ?→ 100.0 what is the mortality of group 1?→ 36/60 what is the % of group 6 ?→ 66.7 / 66.7%what is the mortality of group 4?→ 30/60 what is the dose(mg/kg/day) of group4?→ 10.0 what is the number of animals in group 1?→ 60 what is the mortality of group 1 ?→ 41/60 What is written at the top left end of the page?→ CIGFIL LTD Standalone Balance Sheet for period 01/04/2012 to 31/03/2013 / CIGFIL LTD standalone balance sheet for period 01/04/2012 to 31/03/2013 What is the Date of Board of Directors' meeting in which boards' report referred to under section 217 was approved?→ 29/08/2013 What is the first date mentioned?→ 20 feb / 20 Feb What is the second date mentioned?→ 27 feb What was the name of the person the letter written to?→ Manolo Among the names given at the bottom, who is from New York?→ Mr. Manuel E. Rionda

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehmjf0226_9.png

what is the mortality of group 1 ?

OCR text of the page · 434 characters; the scanned image itself is not published

TABLE 8-Mouse, Female
Group
2
3
4
5
6
Dose (mg/kg/day)
Vehicle Placebo
3.0
10.0
30.0
100.0
Number of Animals
60
60
60
60
60
60
Mortality
41/60
38/60
36/60
30/60
34/60
40/60
68.3
63.3
60.0
50.0
56.7
66.7
Urinary Bladder
Hyperplasia (transitional cell)
Simple
0
0
1(1)
() with lymphoma
Confidential - Subject to Protective Order
TAK-COHENS-00006209
Produced in MDL on 09/14/12
Source: https://www.indupo178-00009s.ucsf.edu/docs/hmjf0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

41/60

Ours

Exact match

41/60

Aux 2015

Wrong

The mortality of group 1 is 41/60 = 0.6833

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Table 8-Mouse, Female Group 2 3 4 5 6 Dose (mg/kg/day) Vehicle Placebo 3.0 10.0 30.0 100.0 Number of Animals 60 60 60 60 60