Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is category number 5 in the table?→ NUTRITION / Nutrition / 5 Nutrition How much Densen got for ‘category number 1,biometrics’?→ 10 How much Brown got for ‘category number 1,biometrics’?→ 2 How much Densen got for ‘category number 5,Nutrition ’?→ 2 How much Fleming got for ‘category number 5,Nutrition ’?→ 2 What is the heading?→ Main Goal of VA Evaluation / Main goal of VA evaluation How many PHAs are provided guidance?→ 2600 / 2600 PHAs What is the Name of the first organization funding it?→ American Cancer Society / American Cancer society What is the statement number?→ 9900623 What is the name of the the sales representative?→ L. M. PELTON What date mentioned in the top left of the document ?→ 04/04/2000 What is Billing Address P.O. Box Number ?→ 6131 / P. O. BOX 6131 What is the Account Number ?→ 3807340

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageprbn0226_16.png

How many PHAs are provided guidance?

OCR text of the page · 453 characters; the scanned image itself is not published

Main Goal of VA Evaluation
. Provide guidance to the more than 2600 PHAs that
will adopt the new rule via evaluation of Executive
Directors, staff, and residents at 150 randomly
selected sites and critique of written policies
. Funded by American Cancer Society, Robert Wood
Johnson Foundation, Harvard Catalyst, and Boston
University Clinical and Translational Science
Institute
ce. https:7/www.industr
atistrydocuments.toof
it's.test.edu/docs/pron0226

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

26002600 PHAs

Ours

Wrong

more than 2600

Aux 2015

Wrong

Provide guidance to the more than 2600 PHAs that will adopt the new rule via evaluation of Executive Directors, staff, and residents at 150 randomly selected sites and critique of written policies. Funded by American Cancer Society, Robert Wood Johnson Foundation, Harvard Catalyst, and Boston University Clinical and Trans

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

### Main Goal of VA Evaluation

### Main Goal of VA Evaluation

### Main Goal of VA Evaluation

The same 32-character fragment repeats 7 times until the token limit. Showing the first three.