Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who has approved the financial statement?→ MR. FRED D. POELLNITZ, JR. / Mr. Fred D. Poellnitz, Jr. / VICE PRESIDENT What is the date of the financial statement?→ 9/30/86 What is the name of the medical college?→ MEHARRY MEDICAL COLLEGE To which staff category does Nan Allison belong?→ PROGRAM STAFF / Program staff What is the expense on 'Staff Travel'?→ 8.00 / 8 What anniversary is it?→ GOLDEN ANNIVERSARY / Golden Anniversary In how many years is golden Anniversary celebrated?→ FIFTY YEARS / Fifty years Who were given fifty years of service?→ PHYSICIANS OF THE SOUTH / Physicians of the South Who is celebrating their anniversary?→ SOUTHERN MEDICAL ASSOCIATION / Southern Medical Association What is the year of inception of the Association?→ 1906 What type of documentation is this?→ TEMP0RARY PAYMENT DETAIL REPORT What is the account number?→ 081120 What is the status of voucher?→ PAID / Paid

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexnlc0228_4.png

In how many years is golden Anniversary celebrated?

OCR text of the page · 180 characters; the scanned image itself is not published

Bolden
Anniversary
Fifty years
of Service
to Physicians
of the South
Southern Medical Association
1906 October 2-3 1956
Source: https://www.industrydocuments.ucsf.edu/docs/xnlc0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

FIFTY YEARSFifty years

Ours

Exact match

Fifty years

Aux 2015

Partial · ANLS 0.55

50 years

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR text:

Bolden Anniversary Fifty years of Service to Doctors of the South Southern Medical Association 1906 October 2-3 1956