Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexqgl0226_10.png

What is the first group mentioned?

OCR text of the page · 568 characters; the scanned image itself is not published
E
ESTIMATED ANNUAL REVENUE BASED ON
VARYING PERCENTAGES OF EACH GROUP
PARTICIPATING IN THE SUGAR RESEARCH FOUNDATION, INC.
& OF
% OF
GROUP
ASSESSMENT
GROUP
ASSESSMENT
Beet Processors
55%
$ 83, 767.54
75%
$114, 228.46
Offshores
40%
21, 223.55
60%
31, 835.31
U.S. Cane Refiners
85%
213, 761.83
90%
226, 336.05
Raw Sugar Producers :
Cuba
40%
23, 634.34
60%
35, 451.50
Puerto Rico
60%
18,091.93
80%
24,122.57
Hawaii
100%
33, 776.26
100%
33, 776.26
$394, 255. 45
$465, 750.15
Based on .5%, .3, and .2, scale of assessment
source: https://www.industry.k
cakedu/does/xqg10226
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
BEET PROCESSORSBeet Processors
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Beet Processors

15 characters5 tokens

Aux 2015

Wrong

Based on the OCR text, the first group mentioned is "Beet Processors".

70 characters18 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Group

Question:

What is the first group mentioned?

OCR text: E ESTIMATED ANNUAL REVENUE BASED ON VARYING PERCENTAGES OF EACH GROUP PARTICIPATING IN THE SUGAR RESEARCH FOUNDATION, INC.

189 characters64 tokens