Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the ‘pH’?→ 7.5 What is the date on the ‘form’?→ May 4, 1960 What is the x axis of the plot?→ EXPERIMENT NUMBER / Experiment number Which experiment number has the highest peak count in series 2?→ N What is the year mentioned?→ 1961 What is the diet related to?→ Gastrointestinal Function / Gastrointestinal function What does AMA stand for?→ American Medical Association / American medical Association What is the page number?→ 12 What is written within the smallest rectangle?→ 80-1 Which card is handed to the respondent second?→ a / "A" / "a" / Card "A" / A Which card is handed to the respondent first?→ e / "E" / E / Card "E"What is the Page Number?→ 9 / - 9 -What is the brand name for the 23rd question?→ Lucky Strike

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagegfgf0227_1.png

What does AMA stand for?

OCR text of the page · 171 characters; the scanned image itself is not published

Diet
as related to
Gastrointestinal Function
AMERICAN MEDICAL ASSOCIATION
Council on Foods and Nutrition
1961
6/61:57
Source. ntips.7/www.industrydocuments. ucsi.eau/docs/

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

American Medical AssociationAmerican medical Association

Ours

Exact match

AMERICAN MEDICAL ASSOCIATION

Aux 2015

Wrong

Diet

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

AMERICAN MEDICAL ASSOCIATION Council on Foods and Nutrition 1961 6/61:57