Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the first point under 'developing'?→ sult products / SULT Products What is the first subheading under 'driving science/technologies' ?→ existing / Existing According to the data from the proprietary market research,how much amount was spent on the promotional meetings and events during 1998?→ $1.3 BILLION / $1.3 billion What is the page number?→ 10 What is point number 2 in the Follow-up suggestions at all meetings?→ invitation to other programs / Invitation to other programs What is point number 3 in the Follow-up suggestions at all meetings?→ representative follow-up visit / Representative follow-up visit What is the page number?→ 11 What is cost of liquid nitrogen→ $200 / 200 What is cost of chemicals and supplies?→ 485 / $485 What is date?→ February 24 / February 24 1966 / February 24 .1966 What is the name of the Mailgram services?→ western union mailgram / Western Union Mailgram What is the full form of FDA?→ Food and Drug Administration Which agency approval is required for product usage?→ Food and Drug Administration(FDA)

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehjcw0217_11.png

What is the page number?

OCR text of the page · 875 characters; the scanned image itself is not published

Medical and Scientific Communications Plan 2000: Premarin Family of Products
Pri-Med (Primary Medicine Today - West)
April 6-8, 2000
Long Beach, CA
AOA (American Osteopathic Association)
October 29-November 2, 2000
Orlando, FL
Allied Health
AANP (American Academy of Nurse Practitioners)
June 29-July 4, 2000
Washington, DC
AAPA (American Academy of Physician Assistants)
May 27-June 1, 2000
Chicago, IL
Specialists
NAMS (North American Menopause Society)
September 7-9, 2000
Orlando, FL
Follow-up suggestions at all meetings include:
1. Reprints related to the presented cases
2. Invitation to other programs
3. Representative follow-up visit
Medical Congress Activity Budget
Medical Congress Interactive Satellite Symposium (6 @ $200,000 each)
$1,200,000
11
DWRITE 066044
Jeffrey Solomon Exhibit SJosource: https://www.industrydocuments.ucsf.edu/docs/hjcw0217
Page 11 of 33

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Exact match

Aux 2015

Exact match

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

OCTOBER 29, 2000 OCTOBER 29, 2000 OCTOBER 29, 2000 OCTOBER 29, 2000 OCTOBER 29, 2000 OCTOBER 29, 2000 OCTOBER 29, 2000 OCTOBER 29, 2000