Frontier to PiT

Output Explorer

Every prompt in the paper, and what each model wrote back.

Answer a question about a scanned page from its OCR text. Scored by exact match and ANLS against the accepted answers.

13 of 5,330 prompts

What is the total shareholders' equity for 2008?→ $42,511 / 42,511 What is the total shareholders' equity for 2007?→ 43,319 / $43,319 What is the title?→ Index How many points are there in the index?→ 7 What is the word common in all the 7 points?→ water / Water Where is the 'drinking water' from?→ Deep well / Drinking water from deep well What is the first item in the index?→ Water from government drain ditch / 1. Water from government drain ditch Who is presenting this?→ Nancy Beck, PhD, DABT Which organization is Nancy associated with?→ American Chemistry Council / ACC What is the 4th concern?→ quantification of the suggestive cancer endpoint / Quantification of suggestive cancer endpoint Which council’s agenda is given?→ governor's pesticide council Which date's agenda is this?→ november 24, 1969 What does the heading of the document say?→ pharmhouse / PhaRmhouse / every thing you need for health and home ...... for less!

Nearby prompts. All 5,330 DocVQA prompts

PromptDocVQA · pagetgph0227_2.png

What is the first item in the index?

OCR text of the page · 285 characters; the scanned image itself is not published

INDEX
1 .
WATER FROM GOVERNMENT DRAIN DITCH
2 .
WATER FROM MAIN WATER TANK
3. WATER FOR WASHING VACUUM FILTERS
4.
WATER FOR WASHING WHITE SUGAR
. WATER IN BOILER FEED TANK
6. WATER IN BOILERS
7. DRINKING WATER FROM DEEP WELL
Source: https://www.industrydocuments.ucsf.edu/docs/tgph0227

System prompt · identical for every setup

Answer the question using only the OCR text from a single document page. Return only the answer, with no explanation. Preserve the answer wording from the OCR text when possible.

Expected answer

Water from government drain ditch1. Water from government drain ditch

Ours

Exact match

WATER FROM GOVERNMENT DRAIN DITCH

Aux 2015

Wrong

1 .

PiT-FT 2015

Wrong

Empty response.

ChronoGPT 2015

Wrong

1 .