Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekgxc0228_6.png

What is written at the top right end of the ‘document’?

OCR text of the page · 980 characters; the scanned image itself is not published
Exhibit C
Wistar Institute
Journal of Nutrition
Computation of Estimated Loss Incurred By
Selling Journals at Less Than Cost to AIN Members
1 Projected less assuming no change in current AIN subscription rates
Year
1960
1961
1962
1963
(1)
(2)
(2)
(2)
Average AIN Subscriptions
574
707
812
912
Total Subscription Cost $20.40 Per Annum
$11,710
$14,423
$16,565
$18,605
Less: Revenue from AIN
Subscriptions . $8.50 per annum
4.879
6.010
6.902
7.752
Total Unrecovered Cost $11.90 per annum
6,831
8,413
9,663
10,653
2 Projected less assuming change in current AIN subscription. rate:
Total Subscription Cost $20.40 per annum
11,710
14,423
16,565
18, 605
Less: Revenue from AIN subscriptions:
$8.50 per annum
# 15.00 per annum (3)
4,879
6,010
20.40 per annums (4)
12, 180
18.605
Total Unrecovered Cost
$ 6,831 $ 8,413
$ 4,385
$ -0-
(1)
Actual
(3 )
Estimated
(4)
Assuming change in rate from $8.50 to $15.00 effective 9/1/61.
Assuming change in rate from 15.00 to $20.40 effective 9/1/62.
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
exhibit cExhibit C
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

Wistar Institute

16 characters4 tokens

Aux 2015

Wrong

The document is a table showing estimated loss incurred by selling journals at less than cost to AIN members. The top right end of the table is the estimated loss column.

174 characters37 tokens

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

120 characters64 tokens

ChronoGPT 2015

Wrong

Exhibit C Wistar Institute Journal of Nutrition Computation of Estimated Loss Incurred by Selling Journals at Less Than Cost to AIN Members 1 Projected less assuming no change in current AIN subscription rates Year 1960 1961 1961 1962 1963 (

241 characters64 tokens