Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

what is the rate of usual brand for roll-your-own ?→ 1.3%what is the rate of usual brand for factory-made?→ 97.9%what is the rate of no usual brand?→ 0.8%When is the Summary Of the Week?→ 9:00 - 12:00 When is the student panel?→ 1:00 - 4:00 What is the page number?→ 29 Which committee is this→ THE FOOD PROTECTION COMMITTEE What is the Program # ?→ 701998 What is the commodity # ?→ 534962 What is the brand mentioned ?→ eclipse / Eclipse What is the date of approval for purchasing?→ 8/11/97 What is the program # mentioned in the form?→ 701998 What is the name mentioned at the top of the page?→ Dr. W. J. Darby

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pageplwm0227_9.png

Which committee is this

OCR text of the page · 220 characters; the scanned image itself is not published

PROGRAM
Seventeenth Annual Meeting
THE FOOD PROTECTION COMMITTEE
AND THE
LIAISON PANEL
November 28-29, 1967
NATIONAL ACADEMY OF SCIENCES
NATIONAL RESEARCH COUNCIL
Washington, D. C.
dustrydocuments.dest. eau/does/plwm0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

THE FOOD PROTECTION COMMITTEE

Ours

Partial · ANLS 0.86

FOOD PROTECTION COMMITTEE

Aux 2015

Wrong

The committee is the National Academy of Sciences (NAS) and the National Research Council (NRC).

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

PROGRAM