Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepycj0037_5.png

which year is focused in the document

OCR text of the page · 1,630 characters; the scanned image itself is not published
BRAND SHARE ANALYSIS - RANKED ON 12 MONTH SHARE
SHARE AND CHANGE VERSUS YEAR AGO
YEAR TO DATE
3 MONTH MVG.
MAY
SHARE
APR
SHARE
MAY
SHARE
6 MONTH MVG.
1994
DIF
DIF
1994
DIF
1994
DIF
0-11
-0.02
0. 11
KS NF
100
o .
0.00
0. 04
0. 00
0. 04
-0.01
0. 04
0. 05
0. 05
-0. 03
0. 05
-0.01
0. 05
LT KSF
0. 00
0 .
0.01
0. 00
0.00
0. 01
0. 00
D. 01
BARCLAY
-o.
0. 09
-0.03
KSF
. 10
0. 05
9.00
0.09
0. 05
0. 02
-0.
-0.03
-0. 02
0. 05
0.01
0. 05
KSF B
0.01
100
0.03
0:00
o .
-0. 01
0. 01
0. 03
-O.
0. 04
0.01
RICHLAND 20
.06
0.01
0.02
0. 05
-D. 06
0.01
0. 05
0. 05
0. 10
0.01
0.01
0. 08
0. 02
-0. 01
KSF B 200 LP
0.00
. 01
5.02
0 . 01
-0.01
0. 00
0.01
0.00
0.00
0. 02
0.00
0.00
0.00
0.00
0.00
FF KSF M LP
0 .
0.00
-0.01
- 0.
-0. 01
.01
-0.01
0.01
0. 01
0.01
- 0.01
0. 01
-0.01
0.01
.00
-0.
O.
0. 00
-0. 01
0.00
-0.
D. 01
SAVANNAH LIGHTS
. 00
. 00
0.00
0.00
- 0. 02
-0.04
. 06
1.00
-0. 04
0. 01
- 0. 02
0. 02
o.
SLM 100 B LP
.0. 03
- 0. 02
0.00
-0. 02
-0. 02
0.01
RICHLAND 25
0.00
.00
0.00
0.00
0.00
0.00
5.00
.00
O.
. 00
.00
0. 00
.00
0. 00
.00
0 .
0.00
.00
0.
0: 00
.00
0.00
0.00
0.00
0. 00
. 00
. 00
.00
-00
0. 00
. 00
. 00
.00
0.00
. 00
0. 00
0. 00
0.00
.00
0:00
0.00
0.00
0.00
0. 00
-00
. 00
0.00
2.00
0.00
.00
0.00
O.
C. 00
1.00
.00
-00
1.00
. 00
0:00
o .
: 0o
0.00
0.00
0.00
0.00
0. 00
LT KSF M LP
0:00
0 .
0. 00
.00
0.00
0. 00
0. 00
0.00
0.00
0. 00
0.00
FALCON
o.
.00
. 00
LT KSF LP
0.00
0. 00
0.00
.00
0.00
o.
.00
. 00
0.00
:00
- 00
0.00
3.00
0.00
.00
0.00
.00
.00
.00
0.00
.00
- 00
0. 00
0.00
.00
0.00
.oo
0. 00
o.
0.00
0. 00
.00
1.00
1.00
0.00
O. 28
6 . 81
0. 4
6. 98
PAGE
45
Source: https://www.industrydocuments.ucsf.edu/docs/pycj0037
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
1994MAY 1994
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

1994

4 characters5 tokens

Aux 2015

Wrong

The document is focused on the 12-month share of RANKED ON (RANKED ON) for the 12-month period ending 30 June 2000. The document includes the following key information:

  • RANKED ON is a leading provider of
222 characters64 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong
- Year to date
- Year to date
- Year to date

The same 15-character fragment repeats 12 times until the token limit. Showing the first three.

189 characters64 tokens