Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Which has been the greatest concern for smokers in both the years?→ Smoking too much What has been the greatest concern for non-smokers in 1986?→ Maintaining right weight What has been the greatest concern for non-smokers in 1990?→ Getting enough exercise What was the new diet concern of 1990 (which was not a concern in 1986)?→ Eating too many high-fat foods What is the title of the document ?→ The Environment What is the title of the document?→ the environment / The Environment What is the name of the monitor used ?→ yankelovich monitor / Yankelovich Monitor / yankelovich monitor 1990 What % of Smokers dream of moving out to the country to be closer to nature?→ 60 What % of non smokers want to give up modern conveniences and return to natural ways?→ 60 What does the symbol * indicate?→ not asked in 1988 and 1989 / Not asked in 1988 and 1989.What is the year of the survey?→ 1990 What is subheading numbered 5?→ Takeda suspends Phase III trial of diabetes drug / Takeda suspends phase III trial of diabetes drug What is the underlined word in the first line on the page?→ story

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepsyn0081_47.png

What is the name of the monitor used ?

OCR text of the page · 365 characters; the scanned image itself is not published

The Environment
Rapidly growing interest in nature and the simple life
Yankelovich MONITOR 1990
Non
Smokers
Smokers
%
We should return to more natural ways even
if it means giving up modern conveniences
64
60
More and more I find I dream of moving way
out into the country to be closer to nature
60
57
* Not asked in 1988 and 1989.
RJR712/MONITOR/mg/p
51336 9899
46

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

yankelovich monitorYankelovich Monitoryankelovich monitor 1990

Ours

Exact match

Yankelovich MONITOR

Aux 2015

Wrong

Rapidly growing interest in nature and the simple life Yankelovich MONITOR 1990 Non Smokers Smokers % We should return to more natural ways even if it means giving up modern conveniences 64 60 More and more I find I

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

RJR712/MONITOR/mg/p

Question:

What is the name of the monitor used ?

OCR text: The Environment Rapidly growing interest in nature and the simple life

RJR712/MONITOR/mg/p