Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the Accounts receivable trade, less allowances for doubtfulaccounts $268 (2007,$193) for 2007?→ 9,444 / $9,444 What is the inventories (Notes 1 and 2) for 2008??→ 5,052 / $5,052 What is the inventories (Notes 1 and 2) for 2007?→ 5,110 / $5,110 What is the total shareholders' equity for 2008?→ $42,511 / 42,511 What is the total shareholders' equity for 2007?→ 43,319 / $43,319 What is the title?→ Index How many points are there in the index?→ 7 What is the word common in all the 7 points?→ water / Water Where is the 'drinking water' from?→ Deep well / Drinking water from deep well What is the first item in the index?→ Water from government drain ditch / 1. Water from government drain ditch Who is presenting this?→ Nancy Beck, PhD, DABT Which organization is Nancy associated with?→ American Chemistry Council / ACC What is the 4th concern?→ quantification of the suggestive cancer endpoint / Quantification of suggestive cancer endpoint

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetgph0227_2.png

How many points are there in the index?

OCR text of the page · 285 characters; the scanned image itself is not published

INDEX
1 .
WATER FROM GOVERNMENT DRAIN DITCH
2 .
WATER FROM MAIN WATER TANK
3. WATER FOR WASHING VACUUM FILTERS
4.
WATER FOR WASHING WHITE SUGAR
. WATER IN BOILER FEED TANK
6. WATER IN BOILERS
7. DRINKING WATER FROM DEEP WELL
Source: https://www.industrydocuments.ucsf.edu/docs/tgph0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

7

Ours

Exact match

7

Aux 2015

Wrong

1

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

1 .