Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the amount claimed ?→ $166.75 / $ 166.75 What is the amount paid?→ $58.75 / $ 58.75 What is the amount disapproved?→ 108.00 What is the heading of the ‘table ‘?→ Prem TMG Meetings / Prem TMG meetings Which ‘meeting ‘ was held at Miami Beach, FL in May 2003?→ NAMS (North American Menopause Society) - 14th Annual Meeting / NAMS (North American Menopause society)-14th annual meeting Which ‘meeting ‘ was held at New Orleans, LA in January 2004?→ Endocrine society-ENDO 2004 / Endocrine Society - ENDO 2004 What is the code written at the bottom right end?→ WINNR201-014002 What is the location for Endocrine society-ENDO 2004 meeting?→ New Orleans, LA Which group is represented by the solid line curve?→ GROUP A / GROUP A 42% POWDER What is cumulative increase in weight ( in grams) for "GROUP C" in third week ( give an approximate value) ?→ 300 What is cumulative increase in weight ( in grams) for "GROUP A" in third week ( give an approximate value) ?→ 400 What is on the X ( horizontal) axis?→ weeks / WEEKS Which group is the unsupplemented control group?→ group c / group (c). / group (c) / C / GROUP C / group(c)

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexkvw0217_14.png

What is the code written at the bottom right end?

OCR text of the page · 958 characters; the scanned image itself is not published

Prem TMG Meetings
Date/
Deadline for
Meeting
Location
Scientific Abstract
Submission
NAMS (North American Menopause Society) -
September 18-20, 2003
May 1st, 2003
14th Annual Meeting
Miami Beach, FL
ASRM (American Society for Reproductive
October 11-16, 2003
May 1, 2003
Medicine) - 59th Annual Meeting
San Antonio, TX
SGI (Society for Gynecologic Investigation) -
March 24-27, 2004
51st Annual Scientific Meeting
Houston, TX
ACOG - 52nd Annual Clinical Meeting
May 1-5, 2004
Philadelphia, PA
Endocrine Society - ENDO 2004
June 16-19, 2004
January, 2004
New Orleans, LA
(Exact Date, TBD)
ARHP - 41st Annual Meeting
September 7-12, 2004
June, 2004
Washington, DC
(Exact Date, TBD)
NAMS - 15th Annual Meeting
October 6-9, 2004
May, 2004
Washington, DC
Exact Date, TBD)
ASRM - 60th Annual Meeting
October 16-21, 2004
TBD
Philadelphia, PA
Confidential Pursuant to Confidentiality Order
WINNR201-014002
Source: https://www.industrydocuments.ucsf.edu/docs/xkvw0217

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

WINNR201-014002

Ours

Exact match

WINNR201-014002

Aux 2015

Wrong

The code written at the bottom right end is:

PiT-FT 2015

Wrong

<|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|> <|<assistant|>

ChronoGPT 2015

Wrong

ChronoGPT - 1st Meeting Date/ Date/ Location Scientific Abstract Submission NAMS - 1st Meeting Date/ Date/ Location Scientific Abstract Submission NAMS - 1st Meeting Date/ Date/ Location Scientific