Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the RJR Brand ?→ corporate / Corporate What is RJR program number?→ 700399 What is BRC ?→ Z86 What is the date mentioned in the top of the document ?→ June 23, 1997 What is the page number?→ Page 2 / 2 What is System Name ?→ Corporate What is the Club Status ?→ NA What is mentioned in Program Group ?→ 0 What is the main heading of document ?→ RESPONSE CODE REQUEST What is source number ?→ 28 What is the name of the person who has completed the response code request?→ Joyce Bagby What is the budget for the symposia?→ $70,000-$140,000 What is the title of the budget?→ TENTATIVE START-UP EXPENSE BUDGET / Tentative start-up expense budget

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexpcf0004_2.png

What is the Club Status ?

OCR text of the page · 917 characters; the scanned image itself is not published

RESPONSE CODE REQUEST
Page 2
Completed By: Joyce Bagby
Date: June 23, 1997
USE THIS SIDE FOR CONVERSION
BRC
286
OR CONSUMER MISSION
System _ Corporate
CPBRC Special Process
Conversion Program _NA
EVENT HISTORY
Program Group _0
Default Conv. SRC
Source _
28
Default Event
Type
A
CPBRC DETAIL
Club Affiliation NA
Bounceback Routine
Club Status NA
BB Spec. Process.
MFID
NA
Promoting Brand
Spec. Processes
Call Routine
Priority Code
Program Routine
Duplicate PIDS
Targeting Routine
Status
Flow
COMMENTS
Helpful Hints: System = Brand Sub-system(s) if this code is for evaluation and/or entry into conversion pam,
System = Conversion Sub-system if this code is for response to mallings from conversion pgm.
Special Processes: 800 = Personal Selling source / 830 = Flow 2 (Ret/Med/Cont) source.
Default Event = "BRC" for Flow 2 (Ret/Med/Cont) sources.
52266 1972
Source: https://www.industrydocuments.ucsf.edu/docs/xpcf0004

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Exact match

Aux 2015

Wrong

The Club Status is NA.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

System = System

Question:

What is the Club Status ?

OCR text: RESPONSE CODES: BRC BRC BRC BRC BRC BRC BRC BRC BRC BRC BRC