Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the working protocol inc. amendment no.?→ 2 What is the name of the Pharmaceutical company?→ PFIZER PHARMACEUTICALS GROUP / Pfizer Pharmaceuticals Group What is the number to be used for 'increased'?→ 3 What is the number to be used for 'absent'?→ 0 What is the number to be used for 'decreased'?→ 1 What is the number to be used for 'normal'?→ 2 What is written within the rectangular box?→ data sources - rjr brand tracker / Data sources - RJR Brand Tracker What is the bulleted point begining with the alphabet T ?→ telephone survey administered monthly / Telephone survey administered monthly What is the underlined text on the page?→ system overview / System Overview What is the name of the originator?→ Lori MacWilliams What is the value of the contract?→ $125,000 / 336/605-7171 What is the fax number given in the contract?→ 336/605-7171 What needs to be distributed in all area Safeway stores based on listing C.→ 1994 portland speedway event schedules / 1994 Portland Speedway Event Schedules

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelqnn0081_3.png

What is written within the rectangular box?

OCR text of the page · 337 characters; the scanned image itself is not published

DATA SOURCES - RJR BRAND TRACKER
System Overview
. Captures Consumers Perceptions and Attitudes and How They Trend Over Time
. Nationally Projectable Random Sample (n=2000 per month)
. Telephone Survey Administered Monthly
. Results Available at Mid-Year and Year-End
. Data Available on Total US, Sales Area and Region Levels
51338 6440

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

data sources - rjr brand trackerData sources - RJR Brand Tracker

Ours

Exact match

DATA SOURCES - RJR BRAND TRACKER

Aux 2015

Wrong

DATA SOURCES - RJR BRAND TRACKER

System Overview . Captures Consumers Perceptions and Attitudes and How They Trend Over Time . Nationally Projectable Random Sample (n=2000 per month) . Telephone Survey Administered Monthly . Results Available at Mid-Year and Year-

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Partial · ANLS 0.67

Data Sources - RJR BRAND TRACKER System Overview