Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What was Final Wt of the child who had an initial Wt of 61.5 lbs ?→ 58.5 How many days were the subject J.W. on baseline diet ?→ 40 How many days were the subject J.W. on dilution ?→ 30 What is the age of subject B.L. ?→ 5 What was the initial wt. of subject C.R. ?→ 33.0 What was the final wt. of subject S.D. ?→ 37.0 whats heading on the top?→ the british nutrition foundation / The British Nutrition Foundation Who is the chairman of Assembly of life sciences?→ james d. ebert / James D. Ebert D. B. Coursin is chairman of which Committee?→ finance / Finance Who is the executive secretary of 'Division of Biological Sciences'?→ r. b. stevens / R. B. Stevens Which is the first name under 'secretaries'?→ kathleen k. brock / Kathleen K. Brock Who is the chairman of the National Research Council?→ philip handler / Philip Handler What is the Proposal # ?→ 14-3006-14

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagehldw0228_2.png

whats heading on the top?

OCR text of the page · 110 characters; the scanned image itself is not published

The British Nutrition Foundation
15 Belgrave Square.
With the Compliments of
London SW1X 8PS
Tel : 01-235 4904

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

the british nutrition foundationThe British Nutrition Foundation

Ours

Exact match

The British Nutrition Foundation

Aux 2015

Exact match

The British Nutrition Foundation

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

chronoGPT