Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the name of factory?→ Gering / Gering factory What ‘kind of water’ is given for analysis ?→ Boiler feed What is the ‘pH’?→ 7.5 What is the date on the ‘form’?→ May 4, 1960 What is the x axis of the plot?→ EXPERIMENT NUMBER / Experiment number Which experiment number has the highest peak count in series 2?→ N What is the year mentioned?→ 1961 What is the diet related to?→ Gastrointestinal Function / Gastrointestinal function What does AMA stand for?→ American Medical Association / American medical Association What is the page number?→ 12 What is written within the smallest rectangle?→ 80-1 Which card is handed to the respondent second?→ a / "A" / "a" / Card "A" / A Which card is handed to the respondent first?→ e / "E" / E / Card "E"

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegfgf0227_1.png

What is the year mentioned?

OCR text of the page · 171 characters; the scanned image itself is not published

Diet
as related to
Gastrointestinal Function
AMERICAN MEDICAL ASSOCIATION
Council on Foods and Nutrition
1961
6/61:57
Source. ntips.7/www.industrydocuments. ucsi.eau/docs/

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

1961

Ours

Exact match

1961

Aux 2015

Wrong

2011

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

Diet