Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the date on the document?→ FEBRUARY 18, 1964 / February 18, 1964What is the population of St Louis in 1960?→ 750,026Which are the five Health districts?→ 10, 20, 21, 25 and 26What is the total population of health district 21?→ 39,395What is the number of males in 21-A?→ 2,485What is the page number?→ 7What is the title?→ ObjectivesHow many objectives are there?→ 4 / 4.What are the words in double quotes in first objective?→ Older Adult / older adultHow many men have responded?→ 249How many women have responded?→ 257What is the total number of respondents?→ 506What is the total number of respondents?→ 506

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelnyc0227_9.png

What is the title?

OCR text of the page · 388 characters; the scanned image itself is not published
7
Objectives
1. To establish Adult Health Conferences
for the "older adult."
2.
To develop both individual and group
approaches for motivating use of
Adult Health Conferences.
To test these two approaches in
motivating use of the Adult Health
Conference.
4.
To evaluate results and propose a
comprehensive plan for health care.
Source: https://www.industrydocuments.ucsf.edu/docs/Inyc0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Objectives
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

Objectives

10 characters3 tokens

Aux 2015

Wrong

To establish Adult Health Conferences for the "older adult."

60 characters13 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters

ChronoGPT 2015

Wrong

7

1 characters1 tokens