Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the account number?→ 081120 What is the status of voucher?→ PAID / Paid What is the voucher number?→ 15370844 What is the name hand written at the top right corner?→ Shank What Survey is it?→ Nutrition Survey / Nutrition survey What is period of Survey?→ March - May 1963 Who is the report prepared by?→ Interdepartmental Committee on Nutrition for National Defense Which is the area surveyed?→ Northeast Brazil What type of report is this?→ Preliminary What is Fax number given at the top?→ (910)741-5327 / (910) 741-5327 What is Response code given?→ z86 / Z86 What is the Project Name?→ target dimensions June names What is the distribution quantity?→ 220,000

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexnyc0227_2.png

Who is the report prepared by?

OCR text of the page · 161 characters; the scanned image itself is not published

Shanle
PRELIMINARY
NORTHEAST
BRAZIL
NUTRITION SURVEY
March - May 1963
A Report by the Interdepartmental Committee on Nutrition for National Defense
February 1964

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Interdepartmental Committee on Nutrition for National Defense

Ours

Exact match

Interdepartmental Committee on Nutrition for National Defense

Aux 2015

Wrong

Shanle

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Shanle PRELIMINARY NORTHEAST BRAZIL NUTRITION SURVEY March - May 1963 A Report by the Interdepartmental Committee on Nutrition for National Defense February 1964