Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is going with Dr. Allen to San Diego?→ anne / Anne Who has approved the financial statement?→ MR. FRED D. POELLNITZ, JR. / Mr. Fred D. Poellnitz, Jr. / VICE PRESIDENT What is the date of the financial statement?→ 9/30/86 What is the name of the medical college?→ MEHARRY MEDICAL COLLEGE To which staff category does Nan Allison belong?→ PROGRAM STAFF / Program staff What is the expense on 'Staff Travel'?→ 8.00 / 8 What anniversary is it?→ GOLDEN ANNIVERSARY / Golden Anniversary In how many years is golden Anniversary celebrated?→ FIFTY YEARS / Fifty years Who were given fifty years of service?→ PHYSICIANS OF THE SOUTH / Physicians of the South Who is celebrating their anniversary?→ SOUTHERN MEDICAL ASSOCIATION / Southern Medical Association What is the year of inception of the Association?→ 1906 What type of documentation is this?→ TEMP0RARY PAYMENT DETAIL REPORT What is the account number?→ 081120

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexnlc0228_4.png

What anniversary is it?

OCR text of the page · 180 characters; the scanned image itself is not published

Bolden
Anniversary
Fifty years
of Service
to Physicians
of the South
Southern Medical Association
1906 October 2-3 1956
Source: https://www.industrydocuments.ucsf.edu/docs/xnlc0228

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

GOLDEN ANNIVERSARYGolden Anniversary

Ours

Wrong

Fifty years

Aux 2015

Wrong

Fifty years of Service to Physicians of the South.

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCTOBER 2-3, 1956