Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexkvw0217_14.png

Which ‘meeting ‘ was held at Miami Beach, FL in May 2003?

OCR text of the page · 958 characters; the scanned image itself is not published
Prem TMG Meetings
Date/
Deadline for
Meeting
Location
Scientific Abstract
Submission
NAMS (North American Menopause Society) -
September 18-20, 2003
May 1st, 2003
14th Annual Meeting
Miami Beach, FL
ASRM (American Society for Reproductive
October 11-16, 2003
May 1, 2003
Medicine) - 59th Annual Meeting
San Antonio, TX
SGI (Society for Gynecologic Investigation) -
March 24-27, 2004
51st Annual Scientific Meeting
Houston, TX
ACOG - 52nd Annual Clinical Meeting
May 1-5, 2004
Philadelphia, PA
Endocrine Society - ENDO 2004
June 16-19, 2004
January, 2004
New Orleans, LA
(Exact Date, TBD)
ARHP - 41st Annual Meeting
September 7-12, 2004
June, 2004
Washington, DC
(Exact Date, TBD)
NAMS - 15th Annual Meeting
October 6-9, 2004
May, 2004
Washington, DC
Exact Date, TBD)
ASRM - 60th Annual Meeting
October 16-21, 2004
TBD
Philadelphia, PA
Confidential Pursuant to Confidentiality Order
WINNR201-014002
Source: https://www.industrydocuments.ucsf.edu/docs/xkvw0217
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
NAMS (North American Menopause Society) - 14th Annual MeetingNAMS (North American Menopause society)-14th annual meeting
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

14th Annual Meeting

19 characters6 tokens

Aux 2015

Wrong

May 1, 2003

11 characters10 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

ChronoGPT - Meeting Date/ Deadline for Meeting Location Scientific Abstract Submission NAMS - 15th Annual Meeting May 1, 2003 May 1, 2003 May 1, 2003 Miami Beach, FL ASRM - 60th Annual Meeting September

202 characters64 tokens