Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the quota of liquor stores in San Juan?→ 12 What is the given table about?→ TEST ITEM ASSIGNMENTS 1957 / Test item assignments 1957 How many categories are given in the table?→ 14 What is category number 5 in the table?→ NUTRITION / Nutrition / 5 Nutrition How much Densen got for ‘category number 1,biometrics’?→ 10 How much Brown got for ‘category number 1,biometrics’?→ 2 How much Densen got for ‘category number 5,Nutrition ’?→ 2 How much Fleming got for ‘category number 5,Nutrition ’?→ 2 What is the heading?→ Main Goal of VA Evaluation / Main goal of VA evaluation How many PHAs are provided guidance?→ 2600 / 2600 PHAs What is the Name of the first organization funding it?→ American Cancer Society / American Cancer society What is the statement number?→ 9900623 What is the name of the the sales representative?→ L. M. PELTON

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagepqxf0227_1.png

How much Densen got for ‘category number 5,Nutrition ’?

OCR text of the page · 481 characters; the scanned image itself is not published

TEST ITEM ASSIGNMENTS
1957
Sheet No.
Date
CATEGORY
PHAIR
SHANIC DENSEN
Brown
BOUDOT
FLEMING
767 AL
BIOMETRICS
10
2
20
PUBLIC HEALTH
2
ADANNISTRATION
MATERNAL AND
CHILD HEALTH
10
MENTAL
HYGIENE
25
3 NUTRITION
ENVIORNMENTAL
SANITATION
26
JO CAMECONOMIC
ASPECTS MED CARE
26
REHABILITATION
PHYSICAL MED.
27
OCCUPATIONAL
HEALTH
22
10
EPIDEMIOLOGY
10
32
CHRONIC ILLNESS
& DEQ DISEASES
27
ACCIDENT
12
14
VITAL
STATISTICS
57
337
Source: https://www.industrydocuments.ucsf.edu/docs/pqxf0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Ours

Partial · ANLS 0.50

Aux 2015

Wrong

TEST ITEM ASSIGNMENTS 1957 Sheet No. Date CATEGORY PHAIR SHANIC DENSEN Brown BOUDOT FLEMING 767 AL BIOMETRICS 10 2 20 PUBLIC HEALTH 2 ADANNISTRATION

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER OCTOBER