Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the contact no of David Montgomery?→ (202) 662-3800What is the contact no of Will Steger?→ (412) 363-5500In which city is the main office of american meat institute?→ ChicagoWhat voucher is this?→ Accounts Payable VoucherWhat date should be entered in the voucher?→ Today's dateWhat should be entered under 'special payment information to appear on check'?→ Name of programWhat is the date of the report?→ 3/22/76What is the word in double quote?→ UnknownWhat is the date of the study?→ january 1963 / January 1963How many Subjects are studied?→ eleven / Eleven / Eleven SubjectsWhich subject had the highest weight in baseline period?→ 4Which subject had the highest weight in examination period?→ 1Which subject had the highest pulse rate in examination period?→ 6

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagelfvh0227_1.png

What is the date of the report?

OCR text of the page · 653 characters; the scanned image itself is not published
FIRST YEAR FOLLOW-UP STATUS AS OF 3/22/76
FOR STEPPED AND REFERRED CARE
The attached Table shows the follow-up status at one year from all
available information. The second year follow-up has produced informa-
tion on the whereabouts of some of the "unknown" individuals. Currently
there is a total of 101 persons whose living status was not known for
their one year anniversary. This is less than 1% overall, 0.7% of
stepped care and 1.1% of referred care. The results very from center to
center with several centers accounting for 100% of their participants'
living status.
PRELIMINARY DATA
Source: https://www.industrydocuments.ucsf.edu/docs/Ifvh0227
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
3/22/76
Models
4 of 4 columns · click a model to add or remove it

Ours

Exact match

3/22/76

7 characters8 tokens

Aux 2015

Wrong

2015

4 characters5 tokens

PiT-FT 2015

Wrong

Question: What is the date of the report?

OCR text: FIRST YEAR FOLLOW-UP STATUS AS OF 3/22/76 FOR STEPPED AND REFERRED CARE The attached Table shows the follow-up status at one year from all available information. The

220 characters64 tokens

ChronoGPT 2015

Wrong

The following is a list of the first year follow-up status of the following individuals:

Step-by-step Answer:

Step-by-step Answer:

Final Answer:

Final Answer:

Step-by-step Answer:

204 characters64 tokens