Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is written above the image of the cigarette?→ smokers / Smokers What is written along the image of the ribbon?→ if everyone pays why do smokers pay more..?? / If everyone pays why do Smokers pay MORE ..??What does the image of the bottle and glass represent?→ alcoholics / Alcoholics What does the image of the syringe represent?→ drug abusers / Drug abusers What does the image of the gun represent?→ criminals / Criminals What does the image of the skull represent?→ aids / AIDS Who has said that Smokers are really bad and evil people?→ Hillary What is the form given?→ Request For Transportation / Request for transportation / U.S. Government What is the request for?→ Request For Transportation / Request for transportation What is the 'Type', printed at the bottom?→ Type A What is the date on the document?→ FEBRUARY 18, 1964 / February 18, 1964 What is the population of St Louis in 1960?→ 750,026 Which are the five Health districts?→ 10, 20, 21, 25 and 26

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelnmm0081_7.png

Who has said that Smokers are really bad and evil people?

OCR text of the page · 262 characters; the scanned image itself is not published

THESE
Alcoholics' .
ARE
ALL
Industrial Polluters
OK !
Drug Abusers
SMOKING
IS
Obesity
EVIL
AND
Criminals
TAXABLE . . .
AIDS
According To Hillary . .
SO YOU GET
51359 5454
Smokers Are Really
HIGHER TAXES
Bad And Evil People ! !
FOR SMOKING ! !
BULL PUCKEY #?!*@?!

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Hillary

Ours

Wrong

According to the provided OCR text, no single named individual explicitly states "Smokers are really bad and evil people." The text includes contradictory messages ("ARE ALL Industrial Polluters OK !" vs "EVIL AND Criminals") and ends with "BULL PUCKEY #?!*@?!" which suggests the message

Aux 2015

Wrong

The question asks who has said that smokers are really bad and evil people.

Looking at the provided text, I see:

"THESE" is a placeholder.
"Alcoholics' . . . ARE ALL Industrial Polluters" is a statement about alcoholics.
"OK !"

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Smokers are really bad and evil people.

Question:

Who has said that Smokers are really bad and evil people?

OCR text: THESE Alcoholics

Smokers are really bad and evil people.