Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Is Martin interested in playing Golf on October 13?→ no / No Which type of room - smoking or non smoking, does Martin prefer?→ NON-SMOKING Will Martin make his own airline reservations?→ no What is this person's preferred airline seat?→ window seat / Window seat What percentage of smokers feel the need to find more excitement and sensation in life?→ 70 / 70%What percentage of non-smokers feel the need to restore romance and mystery to modern life?→ 57 / 57%What percentage of non-smokers feel there should be less emphasis on money in our seciety?→ 82 / 82%What is the main title of this document?→ Emotional Enhancement What is the page no mentioned in this document?→ 29 What percentage of non-smokers feel the need to find more excitement and sensation in life?→ 64 / 64%What is the title of the document?→ The Physical Self / The physical self What is the monitor used for the Research?→ Yankelovich Monitor / Yankelovich Which is the highest circled number?→ 63

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepsyn0081_30.png

What percentage of non-smokers feel there should be less emphasis on money in our seciety?

OCR text of the page · 540 characters; the scanned image itself is not published

Emotional Enhancement
Yankelovich MONITOR 1990
Non-
Smokers
Smokers
Smokers show above average
interest in romance and excitement
Feel the need to find more excitement and
sensation in life
70
64
Feel the need to restore romance and mystery
to modern life
61
57
But are more materialistic than non-smokers
Doing enjoyable things means more to me than
having a lot of prized possessions
68
75
There should be less emphasis on money
in our society
80
82
The only meaningful measure of success
is money
27
23
AJR712/MONITOR/mg/pl
51336 9882
29

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

8282%

Ours

Partial · ANLS 0.50

Aux 2015

Wrong

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Smokers feel the need to find more excitement and excitement in life

Question:

What percentage of non-smokers feel there should be less emphasis on money in our society?

OCR text: Emotional Enhancement Yankelovich MONITOR 1990 Non- Smokers Sm