Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What type of maps do they specialize in?→ old maps / Old maps What is ‘table 2’ ?→ frequency distribution of sweetner usage / Frequency distribution of sweetner usage Among dieters and weight watchers, how many persons used sweetner ‘1-5 times’ ?→ 382 Among dieters and weight watchers, how many persons used ‘31 or more times’ ?→ 59 Among dieters and weight watchers, how many persons used ‘21-30 times’ ?→ 97 Among dieters and weight watchers, how many persons used ‘11-20 times’ ?→ 225 Among dieters and weight watchers, how many persons used ‘6-10 times’ ?→ 128 What is the year of review of pinnacle ultamet experience?→ 2011 What are the ‘dates implanted’?→ 2001~2008 / 2001 2008 How many ‘total implanted’?→ 1100 How many’ no reported revisions’?→ 1087 (98.8%) / 1087 How many ‘ no reported metal reaction revisions’?→ 1094 (99.5%) / 1094 What is the percentage shown under ‘no reported revisions’?→ 98.8%

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefhwc0228_12.png

Among dieters and weight watchers, how many persons used ‘6-10 times’ ?

OCR text of the page · 864 characters; the scanned image itself is not published

Source: 1967/68 Menu Census
TABLE 2
FREQUENCY DISTRIBUTION OF SHEETNER USAGE
- Among Dieters and Weight Watchers
Times Used:
Persons Using
-- --Percent Total Uses---.
No.
%
Liquid
Granule
Tablet
All Other
Total
1 - 5 times
382
42.9%
48.9%
10.4%
26.9%
13.8%
100.0:
6 - 10 times
128
14. 4
52.2
8.5
29.5
9 .8
100.0%
11 - 20 times
225
25.2
46.7
7.3
38.1
7.9
100. C.
21 - 30 times
97
10.9
40.1
13.3
39.9
6.7
100. CT.
31 or more times
59
6.6
39.9
7.8
45.7
6.6
100.03
89 1
100 . 0%
- Among Non - Dieters -
Times Used:
Persons Using
- -Percent Total Uses---
No.
%%
Liquid
Granule
Tablet
All Other
Total
1 - 5 times
273
56.9%
43.8%
9.7%
34. 1%
12.4
100. C
6 - 10 times
78
16.3
50.5
9 . 7
31.6
8. 2
100 . 07:
11 - 20 times
86
17.9
23.2
13.4
55.0
8. 4
100.0:
21 - 30 times
30
6.3
28.8
3.3
50.6
17.3
100 . 0::
31 or more times
13
2.7
2.2
7.0
75.0
15.8
100.G.
480
100.0%
du/doc

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

128

Ours

Exact match

128

Aux 2015

Wrong

We are given a table of frequencies for "times used" (in days) among dieters and weight watchers, with the following information:

Dieters: 1967/68 Menu Census
Weight Watchers: 1967/68 Menu Census

We are to find

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Among Dieters and Weight Watchers Times Used: Persons Using
- Percent Total Uses--- No. % Liquid Granule Tablet All Other Total 1 - 5 times 273 56.9% 43.8% 9.7%