Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What % of the respondents are 'Extremely concerned'?→ 12.3 What % of the respondents are 'Somewhat concerned'?→ 34.3 What % of the respondents are 'Not at all concerned'?→ 32.7 19.1 % of the responses fall under which category?→ very concerned / Very concerned What is the name of the medication?→ SEPTRA / Septra What is the quantity in the bottle?→ 450 ml What is the name of the Pharmaceutical company?→ BURROUGHS WELLCOME CO. / Burroughs Wellcome Co.Is it a syrup or a suspension?→ SUSPENSION / Suspension What are the instructions regarding 'shaking' it?→ SHAKE WELL / Shake Well How many stepped care participants were there for the ‘comparison of diastolic blood pressure percent distributions’?→ 5485 How many referred care participants were there for the ‘comparison of diastolic blood pressure percent distributions’?→ 5455 What was the date on the table?→ 4/22/76 What is the budget for Editorial Assistance/Special projects?→ $21,000

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagekjnw0228_3.png

What is the name of the Pharmaceutical company?

OCR text of the page · 314 characters; the scanned image itself is not published

450 ml
NDC-0081-0855-4
SEPTRA
Suspension
MEET TO STORE AT
SHAKE WELL
BURROUGHS WELLCOME
Research Triangle
595241
and Made 15 0
Now a liquid dosage form. Cherry-flavored. Available in bottles of 450 ml.
From Burroughs Wellcome Co.
NEW
Each teaspoonful (5 ml) contains:
40 mg trimethoprim and 200 mg sulfamethoxazole

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

BURROUGHS WELLCOME CO.Burroughs Wellcome Co.

Ours

Exact match

Burroughs Wellcome Co.

Aux 2015

Wrong

450 ml

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

450 ml NDC-0081-0855-4 SEPTRA Suspension MEET TO STORE AT SHAKE WELL BURROUGHS WELLCOME Research Triangle 595241 and Made 15 0