Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagefpbw0217_18.png

What is the Budget Estimate for Pharmaceutical Compendia Surveillance?

OCR text of the page · 972 characters; the scanned image itself is not published
Medical and Scientific Communications Plan 2000: Premarin Family of Products
information and take action in a timely fashion to revise inaccurate product
information.
Notify major print information sources of new or revised drug information
maintaining the confidentiality of our relationship with Wyeth-Ayerst.
.
Inform commercial information vendors, such as MS, FDB, and the pharmacy
management software vendors they support.
Contact the large retail pharmacy chains and inform them of the need to modify
information they are providing their patients.
Notify influential agencies, such as the National Council on Patient Information and
Education and the FDA, of the need to update incorrect information.
Monitor the quality and timeliness of response by respective information sources.
Pharmaceutical Compendia Surveillance Budget
Pharmaceutical Compendia Surveillance ...........
.............. $100,000
18
Source: https://www.industrydocuments.ucsf.edu/docs/fpbw0217
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
$100,000
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

$100,000

8 characters9 tokens

Aux 2015

Wrong

Pharmaceutical Compendia Surveillance Budget

Pharmaceutical Compendia Surveillance Budget

Pharmaceutical Compendia Surveillance Budget

Pharmaceutical Compendia Surveillance Budget

Pharmaceutical Compendia Surveillance Budget

Pharmaceutical Compendia Surveillance Budget

274 characters54 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

Pharmaceutical Compendia Surveillance Budget

Information:

Pharmaceutical Compendia Surveillance Budget

Information:

Pharmaceutical Compendia Surveillance Budget

Pharmaceutical Compendia Surveillance Budget

Input:

Pharmaceutical Comp

250 characters64 tokens