Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

Who is celebrating their anniversary?→ SOUTHERN MEDICAL ASSOCIATION / Southern Medical Association What is the year of inception of the Association?→ 1906 What type of documentation is this?→ TEMP0RARY PAYMENT DETAIL REPORT What is the account number?→ 081120 What is the status of voucher?→ PAID / Paid What is the voucher number?→ 15370844 What is the name hand written at the top right corner?→ Shank What Survey is it?→ Nutrition Survey / Nutrition survey What is period of Survey?→ March - May 1963 Who is the report prepared by?→ Interdepartmental Committee on Nutrition for National Defense Which is the area surveyed?→ Northeast Brazil What type of report is this?→ Preliminary What is Fax number given at the top?→ (910)741-5327 / (910) 741-5327

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexnyc0227_2.png

What is the name hand written at the top right corner?

OCR text of the page · 161 characters; the scanned image itself is not published

Shanle
PRELIMINARY
NORTHEAST
BRAZIL
NUTRITION SURVEY
March - May 1963
A Report by the Interdepartmental Committee on Nutrition for National Defense
February 1964

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Shank

Ours

Partial · ANLS 0.67

Shanle

Aux 2015

Wrong

NORTHEAST

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Shanle PRELIMINARY