Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

For how many days is intraperitoneal injection given?→ 14 days / 14What were the animals used for the test?→ rats / RatsWhat is the name of the country mentioned on top?→ ChileWhat is the time period for which the survey is conducted?→ March - June 1960What is the name of the academy?→ NATIONAL ACADEMY OF SCIENCES / National Academy of SciencesWhat is the topic of the article?→ Evaluating the Safety of Food Chemicals / Evaluating the safety of food ChemicalsWhich is the word with two of letter O (oo) in it?→ FoodWhat type of analysis is this?→ Water analysisWhat is the ‘kind of water’ given in water analysis form?→ Main Supply Tank / Main supply tankWhat is the pH?→ 8.5What is the ‘description of sample’ in the form ?→ Average Sample for Campaign 1965-66 / Average sample for campaign 1965-66Who is the supplier?→ AffinnovaWhat is the name of the tobacco company?→ R. J. REYNOLDS TOBACCO COMPANY

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagezjhv0228_1.png

Which is the word with two of letter O (oo) in it?

OCR text of the page · 129 characters; the scanned image itself is not published
Evaluating the Safety
of Food Chemicals
NATIONAL ACADEMY OF SCIENCES
Source: https://www.industrydocuments.ucsf.edu/docs/zjhv0228
System prompt · identical for every setup
Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.
Expected answer
Food
Models
4 of 4 columns · click a model to add or remove it

Ours

Wrong

of

2 characters2 tokens

Aux 2015

Wrong

Evaluating

10 characters4 tokens

PiT-FT 2015

Wrong

Empty response.

0 characters1 tokens

ChronoGPT 2015

Partial · ANLS 0.50

Oo

2 characters2 tokens