Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexqgl0226_10.png

What is the alphabet at the top right corner of the page?

OCR text of the page · 568 characters; the scanned image itself is not published
E
ESTIMATED ANNUAL REVENUE BASED ON
VARYING PERCENTAGES OF EACH GROUP
PARTICIPATING IN THE SUGAR RESEARCH FOUNDATION, INC.
& OF
% OF
GROUP
ASSESSMENT
GROUP
ASSESSMENT
Beet Processors
55%
$ 83, 767.54
75%
$114, 228.46
Offshores
40%
21, 223.55
60%
31, 835.31
U.S. Cane Refiners
85%
213, 761.83
90%
226, 336.05
Raw Sugar Producers :
Cuba
40%
23, 634.34
60%
35, 451.50
Puerto Rico
60%
18,091.93
80%
24,122.57
Hawaii
100%
33, 776.26
100%
33, 776.26
$394, 255. 45
$465, 750.15
Based on .5%, .3, and .2, scale of assessment
source: https://www.industry.k
cakedu/does/xqg10226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
E
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

E

1 characters2 tokens

Aux 2015

Wrong

ESTIMATED ANNUAL REVENUE BASED ON VARYING PERCENTAGES OF EACH GROUP PARTICIPATING IN THE SUGAR RESEARCH FOUNDATION, INC. & OF % OF GROUPS ASSESSMENT GROUPS ASSESSMENT GROUPS ASSESSMENT GROUPS ASSESSMENT

202 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

OCR text: E ESTIMATED ANNUAL REVENUE BASED ON VARYING PERCENTAGES OF EACH GROUP PARTICIPATING IN THE SUGAR RESEARCH FOUNDATION, INC. & OF % OF GROUP ASSESSMENT GROUP ASS

169 characters64 tokens