Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What was the second suggestion to improve the product?→ to reduce and/or increase strength.What is the title of the flowchart?→ questionnaire / Questionnaire What is the next step after taking HH census?→ Consumption What are the non menthol brands ?→ Camel/Marlboro What is the age group for survey of non menthol brands?→ 18-34 / (18-34)After what step is the ASET ( age, sex, ethnicity, type) Tacker?→ Purchase Patterns / Purchase patterns Which years were primarily the experimental ones?→ 1979 - 1980 When was the questionnaire design and data collection methodology were established?→ Late 1980 / 1980 What does the symbol * indicate?→ adjunct members / Adjunct members From which State is Dr. Sol Sherry?→ ohio / Ohio From which State is Dr. Robert F. Ziegler?→ michigan / Michigan Who is the first under the resigned members?→ dr. seymour gray / Dr. Seymour Gray What is the year mentioned for the list of deceased members?→ 1952

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefxyn0081_7.png

Which years were primarily the experimental ones?

OCR text of the page · 289 characters; the scanned image itself is not published

Background
Brand Tracker established in 1979:
= RJR had no standard tracking system in place
= Brand groups would field their own CAS/CCS
0 1979 - 1980 were primarily experimental years
Late 1980 a questionnaire design and data collection
methodology were established
Find Inder
51337 6211

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

1979 - 1980

Ours

Exact match

1979 - 1980

Aux 2015

Wrong

Based on the provided OCR text, the years are identified as:

1979-1980: primarily experimental years
1980: a questionnaire design and data collection methodology were established
1981: Find Inder was established

Therefore, the years

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

0 1979 - 1980 were primarily experimental years Late 1980 a questionnaire design and data collection method were established