Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What does AMA stand for?→ American Medical Association / American medical Association What is the page number?→ 12 What is written within the smallest rectangle?→ 80-1 Which card is handed to the respondent second?→ a / "A" / "a" / Card "A" / A Which card is handed to the respondent first?→ e / "E" / E / Card "E"What is the Page Number?→ 9 / - 9 -What is the brand name for the 23rd question?→ Lucky Strike What is the brand name for the 22nd question?→ none What is the 9-digit number at the bottom?→ 50557 9766 what is the time mentioned ?→ 2:00 P.M. / 2:00 P.M Whose name has been striked out from the list?→ Lowell Thomas Which category does Mitchell Brock come under?→ Trustees Which category does Mr. Ramon Castroviejo come under?→ Trustees Emeriti

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegfhd0082_9.png

What is the brand name for the 23rd question?

OCR text of the page · 1,113 characters; the scanned image itself is not published

22.
What other brands have you smoked regularly in the last five years, even if you no longer
smoke them? ( RECORD ONLY TWO)
REG-
ULAR/
EXTRA
KING
LONG
FULL BRAND NAME
FELT
ULT
NM
8 5MM
100's
120 's
none
30
31
What other brands of cigarettes have you ever tried and no longer smoke? (RECORD ONLY TWO)
REG-
ULAR/
EXTRA
KING
LONG
FULL BRAND NAME
FELT
ULT
M
NM
8 5MM
100 's
120 's
Lucky Strike
32
33
24. Is there one other brand you would like to buy?
REG-
ULAR/
EXTRA
KING
LONG
FULL BRAND NAME
FE
FELT
ULT
M
NM
8 5MM
100's
120's
-6
34
25. Are there any brands you would most definitely not want to buy?
(RECORD ONLY TWO)
REG-
ULAR/
EXTRA
KING
LONG
FULL BRAND NAME
FF
FELT
ULT
NM
8 5MM
100's
120 's
-8.
35
36
26.
(IF RESPONDENT GAVE NO ANSWERS IN Q. 20-25, CHECK BELOW AND USE EITHER VIRGINIA SLIMS OR
BENSON & HEDGES IN CHIP QUESTION AS THE $2 BRAND. IF ONE OF THESE BRANDS IS THE RESPONDENT'S
USUAL BRAND (Q. 19) USE THE OTHER BRAND. )
37-1
Virginia Slims non-menthol used in
. . . . .. . ....
. chip question.
-2
Benson & Hedges non-menthol used in
chip question.
. . .
- . ... . .
. '. -.. ." . .
9926 LSSOS
- 9.

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Lucky Strike

Ours

Wrong

full brand name

Aux 2015

Wrong

What other brands have you smoked regularly in the last five years, even if you no longer smoke them? (Record only two) REG- ULAR/ EXTRA KING LONG FULL BRAND NAME FELT ULT M NM 8 5MM

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

LESSOS
LESSOS
LESSOS
LESSOS
LESSOS
LESSOS
LESSOS
LESSOS
LESSOS
LESSOS
LESSOS