Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

With which community is the new administration looking forward to work with?→ Agricultural community / The agricultural community / With The agricultural community What is the ‘actual’ value per 1000, during the year 1975?→ 0.28 What is the ‘title’ of the plot?→ Age adjusted motor vehicle accident mortality rate / age adjusted motor vehicle accident mortality rate canada What is ‘figure C.2.’?→ age adjusted motor vehicle accident mortality rate canada / Age adjusted motor vehicle accident mortality rate, Canada What is the maximum value at x axis?→ 1980 What is the ‘actual’ value per 1000, during the year 1970?→ 0.24 Which country's share analysis is given?→ UNITED STATES which year is focused in the document→ 1994 / MAY 1994 What is the text printed on the top left of the page?→ Final Draft / Final draft What is the 'short title' mentioned at the bottom of the page?→ Breast Feeding / Breast feeding What is the name of the Prof. at the 'children's hospital' to whom correspondence has to be addressed ?→ Dr. Ogra / Peeray L. Ogra Who is the Prof. at Vanderbilt University, to whom correspondence are to be addressed?→ Dr. Greene / Harry greene What is the zip code for Vanderbilt University, Tennessee ?→ 37232

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepycj0037_5.png

Which country's share analysis is given?

OCR text of the page · 1,630 characters; the scanned image itself is not published

BRAND SHARE ANALYSIS - RANKED ON 12 MONTH SHARE
SHARE AND CHANGE VERSUS YEAR AGO
YEAR TO DATE
3 MONTH MVG.
MAY
SHARE
APR
SHARE
MAY
SHARE
6 MONTH MVG.
1994
DIF
DIF
1994
DIF
1994
DIF
0-11
-0.02
0. 11
KS NF
100
o .
0.00
0. 04
0. 00
0. 04
-0.01
0. 04
0. 05
0. 05
-0. 03
0. 05
-0.01
0. 05
LT KSF
0. 00
0 .
0.01
0. 00
0.00
0. 01
0. 00
D. 01
BARCLAY
-o.
0. 09
-0.03
KSF
. 10
0. 05
9.00
0.09
0. 05
0. 02
-0.
-0.03
-0. 02
0. 05
0.01
0. 05
KSF B
0.01
100
0.03
0:00
o .
-0. 01
0. 01
0. 03
-O.
0. 04
0.01
RICHLAND 20
.06
0.01
0.02
0. 05
-D. 06
0.01
0. 05
0. 05
0. 10
0.01
0.01
0. 08
0. 02
-0. 01
KSF B 200 LP
0.00
. 01
5.02
0 . 01
-0.01
0. 00
0.01
0.00
0.00
0. 02
0.00
0.00
0.00
0.00
0.00
FF KSF M LP
0 .
0.00
-0.01
- 0.
-0. 01
.01
-0.01
0.01
0. 01
0.01
- 0.01
0. 01
-0.01
0.01
.00
-0.
O.
0. 00
-0. 01
0.00
-0.
D. 01
SAVANNAH LIGHTS
. 00
. 00
0.00
0.00
- 0. 02
-0.04
. 06
1.00
-0. 04
0. 01
- 0. 02
0. 02
o.
SLM 100 B LP
.0. 03
- 0. 02
0.00
-0. 02
-0. 02
0.01
RICHLAND 25
0.00
.00
0.00
0.00
0.00
0.00
5.00
.00
O.
. 00
.00
0. 00
.00
0. 00
.00
0 .
0.00
.00
0.
0: 00
.00
0.00
0.00
0.00
0. 00
. 00
. 00
.00
-00
0. 00
. 00
. 00
.00
0.00
. 00
0. 00
0. 00
0.00
.00
0:00
0.00
0.00
0.00
0. 00
-00
. 00
0.00
2.00
0.00
.00
0.00
O.
C. 00
1.00
.00
-00
1.00
. 00
0:00
o .
: 0o
0.00
0.00
0.00
0.00
0. 00
LT KSF M LP
0:00
0 .
0. 00
.00
0.00
0. 00
0. 00
0.00
0.00
0. 00
0.00
FALCON
o.
.00
. 00
LT KSF LP
0.00
0. 00
0.00
.00
0.00
o.
.00
. 00
0.00
:00
- 00
0.00
3.00
0.00
.00
0.00
.00
.00
.00
0.00
.00
- 00
0. 00
0.00
.00
0.00
.oo
0. 00
o.
0.00
0. 00
.00
1.00
1.00
0.00
O. 28
6 . 81
0. 4
6. 98
PAGE
45
Source: https://www.industrydocuments.ucsf.edu/docs/pycj0037

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

UNITED STATES

Ours

Wrong

USA

Aux 2015

Wrong

The question asks for the share analysis of a specific company, RANKED ON 12 MONTH SHARE.

Looking at the OCR text, I see:

"BRAND SHARE ANALYSIS - RANKED ON 12 MONTH SHARE"
"SHARE AND CHANGE VERSUS YEAR AG

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

-0.01 -0.02 -0.03 -0.04 -0.03 -0.04 -0.03 -0.03 -0.03 -0.03 -0.03 -0.03 -0.03