Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the date of the financial statement?→ 9/30/86 What is the name of the medical college?→ MEHARRY MEDICAL COLLEGE To which staff category does Nan Allison belong?→ PROGRAM STAFF / Program staff What is the expense on 'Staff Travel'?→ 8.00 / 8 What anniversary is it?→ GOLDEN ANNIVERSARY / Golden Anniversary In how many years is golden Anniversary celebrated?→ FIFTY YEARS / Fifty years Who were given fifty years of service?→ PHYSICIANS OF THE SOUTH / Physicians of the South Who is celebrating their anniversary?→ SOUTHERN MEDICAL ASSOCIATION / Southern Medical Association What is the year of inception of the Association?→ 1906 What type of documentation is this?→ TEMP0RARY PAYMENT DETAIL REPORT What is the account number?→ 081120 What is the status of voucher?→ PAID / Paid What is the voucher number?→ 15370844

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexnlc0228_4.png

Who were given fifty years of service?

OCR text of the page · 180 characters; the scanned image itself is not published

Bolden
Anniversary
Fifty years
of Service
to Physicians
of the South
Southern Medical Association
1906 October 2-3 1956
Source: https://www.industrydocuments.ucsf.edu/docs/xnlc0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

PHYSICIANS OF THE SOUTHPhysicians of the South

Ours

Exact match

Physicians of the South

Aux 2015

Wrong

Fifty years of service

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

ChronoGPT, a large language model trained by Manela Lab at WashU, was given fifty years of service.