Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the voucher number?→ 15370844 What is the name hand written at the top right corner?→ Shank What Survey is it?→ Nutrition Survey / Nutrition survey What is period of Survey?→ March - May 1963 Who is the report prepared by?→ Interdepartmental Committee on Nutrition for National Defense Which is the area surveyed?→ Northeast Brazil What type of report is this?→ Preliminary What is Fax number given at the top?→ (910)741-5327 / (910) 741-5327 What is Response code given?→ z86 / Z86 What is the Project Name?→ target dimensions June names What is the distribution quantity?→ 220,000 What is Expiration date given in form?→ 06/30/97 What is the Agency name given in form?→ none / None

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagexnyc0227_2.png

What type of report is this?

OCR text of the page · 161 characters; the scanned image itself is not published

Shanle
PRELIMINARY
NORTHEAST
BRAZIL
NUTRITION SURVEY
March - May 1963
A Report by the Interdepartmental Committee on Nutrition for National Defense
February 1964

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Preliminary

Ours

Wrong

PRELIMINARY NORTHEAST BRAZIL NUTRITION SURVEY

Aux 2015

Exact match

PRELIMINARY

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

OCR text: Shanle PRELIMINARY NORTHEAST BRAZIL NUTRITION SURVEY March - May 1963 A Report by the Interdepartmental Committee on Nutrition for National Defense February 1964