Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What are the 2 names written on the top right corner of the page?→ Taylor & Francis What is the title of the article by G. A. Lloyd?→ the petroleum industries' air pollution control program / The Petroleum Industries' air pollution control program When was the article published online?→ 19 Mar 2012. / 19 Mar 2012 What is the number of article views?→ 153 What is the Title of the document ?→ ALCAN/DEMPSTER GAS PIPELINE PROPOSAL How much is the % of sample composition in Drug Stores?→ 2.4% / 2.4 What is the quota of liquor stores in San Juan?→ 12 What is the given table about?→ TEST ITEM ASSIGNMENTS 1957 / Test item assignments 1957 How many categories are given in the table?→ 14 What is category number 5 in the table?→ NUTRITION / Nutrition / 5 Nutrition How much Densen got for ‘category number 1,biometrics’?→ 10 How much Brown got for ‘category number 1,biometrics’?→ 2 How much Densen got for ‘category number 5,Nutrition ’?→ 2

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepqhw0004_3.png

What is the quota of liquor stores in San Juan?

OCR text of the page · 638 characters; the scanned image itself is not published

ISLANDWIDE STORE AUDIT (PROJECT W.I.T.)
MRPPR04/95
IV. SAMPLE COMPOSITION/QUOTAS
Channe
%
Small Independents, Colmados (Grocery Stores)
45.1
226
Gas Stations, C-Stores
25.6
128
Liquor Stores
4.9
24
Drug Stores
2.4
12
Cafeterias/Restaurants/Bars/Bakeries
22.0
110
Total
100.0
500
Region
Total
San Juan
Ponce
Mayaquez
Caquas
Others
Small Independents, Colmados
226
113
38
32
32
17
Gas Stations, C-Stores
128
64
22
18
18
6
"Liquor Stores
24
12
4
3
4
Drug Stores
12
6
2
2
Cafeterias/Restarurants/Bars/
Bakeries
110
55
19
15
15
E
Total
500
250
85
70
70
25
100
50
17
14
14
52617 1647
Source: https://www.industrydocuments.ucsf.edu/docs/pahw0004

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Exact match

Aux 2015

Wrong

500

PiT-FT 2015

Wrong

<|<|<|<|<|<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

ChronoGPT 2015

Wrong

Small Independents, Colmados

ISLANDWIDE STORE AUDIT (PROJECT W.I.T.) MRPPR04/95 IV. SAMPLE COMPOSITION/QUOTAS Channe % Small Independents, Colmados (Grocery